System Design Basics: Avoiding Single Points of Failure in Distributed Systems

What is a Single Point of Failure?