Why Is the Context Window Limited in LLMs?

If you’ve ever tried to paste a massive document into an AI and gotten an error, you’ve hit the context window limit.