Generative Auxiliary Training as Anti-Collapse Regularization in Large Language Models

When you fine-tune a large language model for classification, you optimize a single objective: predict the correct label. The model learns…