lucidrains / g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch
MIT License
417 stars 58 forks source link

pre-trained model #6

Closed davidmrau closed 3 years ago

davidmrau commented 3 years ago

Thanks for your amazing work. Has anyone trained the LM already? In other words is a pre-trained gMLP available?

lucidrains commented 3 years ago

@davidmrau not at the moment David! the official repo isn't even out yet

davidmrau commented 3 years ago

Thanks for the quick response!