Calibration set size for LLM-as-judge: when 50 traces is enough and when 200 is mandatory

A practitioner’s guide to sizing the human-labeled set you use to validate an automated judge, with the kappa variance math, Wilson…