The Hidden Danger of PEFT: Why Your Fine-tuned Model Forgot Everything

Your LoRA-fine-tuned model performs flawlessly on your new domain task. But suddenly, it fails basic math questions, struggles with safety…