Micro-GPT2 — Building GPT-2 (124M) from Scratch in PyTorch

Ever wondered what actually happens inside GPT-2 — the model that kicked off the modern era of large language models?