Nobody Invented PPO From Scratch

Reinforcement learning algorithms are usually taught as a list. But each one exists because the previous one had a specific, painful…