Online Softmax to Flash Attention — and Why it Matters

Connecting the Key Optimizations from Online Softmax to Flash Attention