How I Built a Self-Scaling AI Inference Cluster from Scratch

From a single model running on a laptop to a distributed system serving hundreds of users — and what I learned along the way.