Why LoRA Stops Improving: The Hidden Geometry Behind Rank 4, 8 vs 64

A practical way to use Singular Value Decomposition (SVD) to predict when low-rank adaptation fails