Multihead Attention: How One Model Reads a Sentence 144 Ways

Walkthrough of the last piece of self-attention—12 heads per layer and the two matrices that hold it all together.