lucidrains / axial-attention

Implementation of Axial attention - attending to multi-dimensional data efficiently
MIT License
346 stars 30 forks source link

AxialPositionalEmbedding #4

Closed dansola closed 3 years ago

dansola commented 3 years ago

Would you be able to provide an example of how to add the positional encoding with the AxialPositionalEmbedding class or explain what the emb_dim, emb_dim_index, and dimensions arguments are specifically? Thanks for the repo!

lucidrains commented 3 years ago

@dansola I added a section near the end! Hope it helps!

dansola commented 3 years ago

Thank you @lucidrains!