Reward Hacking, Structural Collapse, and the search for a stable signal in RL.

By Jen Wei