Criss-Cross Attention & Axial Attention

xmu-xiaoma666 / External-Attention-pytorch

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

MIT License

11.27k stars 1.92k forks source link

Open Liqq1 opened 2 years ago

Liqq1 commented 2 years ago

Hello, I think Criss-Cross Attention & Axial Attention are also the commonly used attention mechanisms.

iscyy commented 2 years ago

already joined