SHI-Labs / Neighborhood-Attention-Transformer

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
MIT License
1.05k stars 86 forks source link

For 3D segmentation #96

Closed LambdaLi closed 6 months ago

LambdaLi commented 11 months ago

Your work is breathtaking, I asked a naive question, can it be used in 3D image segmentation now? I only know 1D and 2D in your natten, are you still developing?

alihassanijr commented 11 months ago

Thank you for your interest. There is a basic 3D NA in NATTEN right now, you'd just need to build it from source. However, it's a very limited implementation, so I wouldn't expect much from it performance wise.

And yes, NATTEN development is still ongoing, and we're going to have more releases coming up soon.

alihassanijr commented 6 months ago

Closing this due to inactivity. We recently integrated our new Fused Neighborhood Attention kernel in NATTEN, which supports 1D, 2D and 3D.