The AI Was Confident. It Was Also Wrong.

What I learned designing human oversight for an AI agent that can recommend consequential real-world actions.