Tencent / TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
Other
1.47k stars 196 forks source link

Any plan on supporting Vision Transformer? #225

Open ydzhang12345 opened 3 years ago

ydzhang12345 commented 3 years ago

Hi,

Thank you for your awesome work! I would like to know if there is any plan on supporting vision-based Transformer? As transformers are becoming popular in vision tasks, I believe this will be a great tool for vision tasks as well.

feifeibear commented 3 years ago

Hey, We noticed that the Transformers are becoming popular in CV. We currently have no plan to update new models. However, we believe it is easy to be adopted in other attention-based models.