search

dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.55k stars 538 forks source link

[Model] Add Performer #1422

Open sxjscience opened 3 years ago

sxjscience commented 3 years ago

Description

Add Performer to our model zoo:

Code in flax: https://github.com/google-research/google-research/tree/master/performer/fast_self_attention

Some reference implementations in PyTorch: https://github.com/lucidrains/performer-pytorch

One choice is to add a pytorch-based model.