LLM Inference Optimization: Speculative Decoding, KV-Cache, and Quantization Explained

The engineering behind making large language models fast and cheap to run in production.