I want to use Peroformer on MAE

lucidrains / performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

MIT License

1.07k stars 143 forks source link

Open Zhaoyi-Yan opened 1 year ago

Zhaoyi-Yan commented 1 year ago

Hi, I want to use performer on images, eg, adopting it in MAE. Is there anything that I should pay attention to? Thank you!