I Tried to Run a 26B MoE on an 8GB GPU and Beat Ollama.

Or: what a 128-expert mixture-of-experts model taught me about cache locality, nonlinear norms, and why you should never trust argmax.