Growing Logic: Why Training Neural Networks Is Becoming a Materials Science

For years, the mechanistic interpretability community has watched the phenomenon of “grokking” with a mixture of awe and frustration. We…