Your A/B Test Is Lying to You: 6 Pitfalls and How to Catch Them

Peeking, multiple comparisons, Simpson’s paradox, sample-ratio mismatch, novelty effects, and underpowered tests — the mechanism behind…