AXIS: From Error to Improvement: How Neural Networks Actually Learn — Gradient Descent, Intuitively

Back-propagation tells us what went wrong. Gradient descent tells us how to fix it.