#deepspeed-zero-3

Scaling Qwen2.5‑VL Fine‑Tuning with DeepSpeed ZeRO‑3 Across Two DGX Sparks (Docker, Detached)

Fine‑tuning a 32B‑parameter vision‑language model is where “it works on my laptop” stops being a joke and starts being an outage risk. In…