search

SHI-Labs / Neighborhood-Attention-Transformer

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
MIT License
1.04k stars 85 forks source link

Gradcheck fixes #64

Closed alihassanijr closed 1 year ago

alihassanijr commented 1 year ago

Updates gradient checks in NATTEN, because NA1D and NA2D now expect dilation, which is not passed.

Fixes #63 .