How I Distilled a Gemini Vision Model Into a 4.6M-Parameter

Knowledge distillation onto frozen image embeddings in PyTorch: the negative-transfer trap, the micro-class fix, no GPU.