Multi-Teacher Knowledge Distillation: Replacing a Paid API with a Self-Hosted SFT 9B Model

How nine free-tier APIs replaced a frontier LLM — using a trick from Hinton’s 2015 paper.