What is Swin Transformer and how does it improve Vision Transformers?

Swin Transformer introduces hierarchical feature maps and window-based attention for efficiency.

Swin Transformer improves ViT by computing self-attention within local windows instead of global attention, reducing computational complexity. It also uses shifted windows to allow cross-window connections. This creates a hierarchical representation similar to CNN feature pyramids.