Gumbel trick teaches you to Sample From a Distribution by Adding Noise and Pointing at the Biggest…

You want your model to make a random choice — pick a word, draw a sample, roll a weighted die.