#gmlp

Is Self-Attention Overrated? Meet gMLP, the Simple Model That’s Challenging Transformers

In the world of artificial intelligence, the Transformer architecture is the undisputed heavyweight champion. Since its debut in 2017, it…