Understanding “Bits” in CPUs: More Than Just a Number

What exactly determines a processor’s “bit-ness,” and what impact does it really have?