How LLMs Actually Work: The Hidden State Is the Story

A visual mental model of Transformers: token IDs become hidden states, attention and MLPs rewrite them, and logits turn them back into…