The mathematics behind a drunkard’s walk

Random walk is an important concept of probability and mathematical finance — but what exactly is it and why should I care?