Gradient Descent- understanding the black box optimizer

Most machine learning tasks can be modeled as minimization problems and this is why it is imperative to understand the gradient descent…