Not Where You Are, But How Far Apart: How RoPE Gave Transformers a Better Sense of Order

Pull quotes: