Adam vs AdamW: Why Weight Decay Needed a Fix

A deep dive into Adam, weight decay, and why AdamW matters