Energy-Based Transformers

What the architecture inherits from classical energy models, and where that leaves it