Optimizing MoE Inference Latency on H200: What Worked, What Didn’t

Learnings from a few weeks of trying to make Mixture-of-Experts models go faster on H200. A B200 follow-up will come later, the playbook…