Mathematical justification of Stochastic Gradient Descent

Minimising cost function is the holy grail of machine learning. Gradient descent is our master key to all cost minimisation problems. But…