From 1,540 to 15,338 Tokens per Second on a Single TPU Chip

A Measurement Study of Large Language Model Inference Optimization on TPU v5e: Throughput, latency, energy, and cost results for Gemma 2B…