Literature

[xin-huang]

Fully attentional networks:

• Fully Attentional Network for Semantic Segmentation
• Understanding The Robustness in Vision Transformers

Axial attention:

• CCNet: Criss-Cross Attention for Semantic Segmentation
• Axial Attention in Multidimensional Transformers
• Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation

Attention + U-Net:

• Attention U-Net: Learning Where to Look for the Pancreas
• U-Net Transformer: Self and Cross Attention for Medical Image Segmentation

[xin-huang]

More architectures https://encord.com/blog/image-segmentation-for-computer-vision-best-practice-guide/