I Quantized and Fine-Tuned a 7B Model on a Free GPU. Turns Out That’s the Easy Part.

4-bit quantization, LoRA fine-tuning, and DSPy prompt compilation on a single T4. The part that helped most wasn’t the training.