The Problem Swin Transformer Solves

The biggest challenge with using standard Transformers for images is the math. Standard self-attention compares every single pixel to every…