GPU kernel optimization: Online Softmax

Let’s look at the last optimization that is used by modern LLM frameworks to perform Softmax efficiently over large inputs