I Built an LLM Inference Engine on a 15 year old GPU and the Math was the Easy Part

There’s a fun lie that gets talked about AI engineering, that the hard part is the machine learning. The math. The architecture. The loss…