Floating Point Fabrication: The Math Tricks Inside vLLM’s 4-Bit Dequantizer for Marlin

In high-performance LLM inference, the bottleneck is rarely compute; it’s memory bandwidth. Reading 16-bit weights across the GPU bus is…