Speculative Decoding in LLMs

Before diving into speculative decoding, it's important to understand the concept of decoding in NLP. Decoding refers to the process by…