PagedAttention: vLLM’s Solution to GPU Memory Waste

Part 2 of the Understanding LLM Serving series
Read the series: Part 1 • Part 2 • Part 3