How did Sarvam Optimize and Serve Large MOEs on NVIDIA GPUs?

Recently there was a talk presented jointly by Ashwin from Sarvam and Utkarsh Uppal from NVIDIA at the Sarvam epoch conference explaining…