The Mathematics of “Grokking”

A network memorizes everything, understands nothing, then suddenly it does.