Interpreting Deep Neural Networks: Memorization, Kernels, Nearest Neighbors, and Attention

In this post, we will present a perspective on viewing Deep neural networks (DNNs) as retrieval machines that memorize their training data…