One GPU Wasn’t Enough: My Journey Scaling PyTorch DDP Across AWS EC2 Instances

A Practical Guide to Multi-Node Training