Optimizers in Deep Learning: From Gradient Descent to Adam

A practical, math-grounded tour of the algorithms that actually teach neural networks how to learn.