Rethinking the Bottleneck: Why Speculative Decoding is Stuck on “Word-for-Word” Alignment

Standard Speculative Decoding (SD) has a bit of a perfectionism problem. The traditional workflow is straightforward: a small, fast “draft”…