Silicon Built for One Thing: How Custom AI Hardware Is Smashing the Throughput Ceiling

In March 2024, NVIDIA unve​iled the Blac‌kwell ar⁠chitecture and announced that a single G​B200 NVL​72 rack 72 GPUs co​nnected by NVLink…