can i use axial position embedding on 3D images directly?

lucidrains / axial-attention

Implementation of Axial attention - attending to multi-dimensional data efficiently

MIT License

346 stars 30 forks source link

can i use axial position embedding on 3D images directly? #13

Open Uljibuh opened 5 months ago

Uljibuh commented 5 months ago

hi, thanks for your effort and great work,

I am working on the 3D image, I want to apply axial attention to the transformer, I am wondering if can i use axial position embedding directly on the 3D image.