What is Backpropagation?

When newbies just started learning Neural Networks, they often hear “Back Propagation” but have no idea what it is. Believe me. I was once…