The Evolution of LLM Inference: Decoding algorithms — Part 1

LLM inference optimization can be understood along three major axes: memory optimization, compute optimization, and decoding algorithms…