My Model Was 96% Accurate. And I Still Didn’t Trust It.

High accuracy is necessary but not sufficient. Here’s how Grad-CAM revealed what a pneumonia classifier was actually looking at — and why…