Streaming softmax: the recurrence that makes FlashAttention work

A two-state recurrence (log-sum-exp with a running-max correction factor) turned 200K-token context windows from a hardware fantasy into a…