search

lucidrains / rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
MIT License
535 stars 43 forks source link

RoPE on Images #19

Closed aaprasad closed 8 months ago

aaprasad commented 8 months ago

Hi, really helpful implementation! I know RoPE was originally designed for NLP tasks but I was wondering how it might be extended to other domains like computer vision with images?

lucidrains commented 8 months ago

there's an example in the readme for axial rotary embeddings, allowing for images and video support