Understand skip-trigram in a one-layer attention-only transformer with Pytorch

The classic Anthropic’s paper “A Mathematical Framework for Transformer Circuits” looked into the functions of one-layer attention-only…