Rotary Positional Embedding (RoPE)

Introduction to Positional Embeddings