lukemelas / PyTorch-Pretrained-ViT

Vision Transformer (ViT) in PyTorch
770 stars 124 forks source link

Would you consider creating a MLP-Mixer project like this? #17

Closed jikerWRN closed 3 years ago

jikerWRN commented 3 years ago

Hi, would you consider creating a MLP-Mixer project like this? Thanks!

lukemelas commented 3 years ago

Hi,

I was actually working on the same idea as MLP-Mixer when it came out. It's here: https://github.com/lukemelas/do-you-even-need-attention

Hope that helps!

jikerWRN commented 3 years ago

Ok, thanks!