The Bonsignore Kernel

We built a custom GPU operator that replaces the dot product in attention with a learned scoring function. It’s 25% faster than PyTorch at…