Beyond Backpropagation: How EGGROLL Scales Evolution Strategies to Train Billion-Parameter Models

The Gradient Problem No One Talks About