search

lucidrains / axial-attention

Implementation of Axial attention - attending to multi-dimensional data efficiently
MIT License
346 stars 30 forks source link

Axial-deeplab #6

Closed sahilrider closed 3 years ago

sahilrider commented 3 years ago

Hello, Is it possible to build axial-deeplab with help of the provided axial-attention blocks? Any suggestion on how to do so?

lucidrains commented 3 years ago

@sahilrider Hi Sahil! Axial deeplab is a bit different - it incorporates relative positional encoding. I believe there's already a pytorch repository out there for it

sahilrider commented 3 years ago

Yes, right its positional encoding is different. The code repo is available but it's only for Axial-ResNet. I wanted to extend it to axial-deeplab by implementing a decoder network.

Thanks for the clarification.