[Framework] The Asymmetric Key-Value Cache Compression

Why hardware pipelines hate irregular memory layouts and what you should do instead.