Cutting LLM Memory by 84%, A Deep Dive into Fused Kernels

Why your final LLM layer is OOMing and how to fix it with a custom Triton kernel.