Beyond DeepSeek’s Engram: What If Compressed Attention Didn’t Have to Be Lossy?

DeepSeek has shipped two ideas in the last year that I keep coming back to. The first is Engram, from their paper on Conditional Memory via…