The Distillation Illusion: Sounding Like the Teacher Is Not the Same as Judging Like the Teacher

Distillation is not magic.