search

SHI-Labs / Neighborhood-Attention-Transformer

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
MIT License
1.04k stars 85 forks source link

HF announcement + minor fixes. #72

Closed alihassanijr closed 1 year ago

alihassanijr commented 1 year ago

HuggingFace Models and transformers integration announcement.

Issues

✅ Fixes #6 .

Other issues fixed

Classification models

✅ Fixes DiNAT-L # of heads mismatch. ✅ Fixes DiNAT-B LayerScale mismatch.