google-research / long-range-arena

Long Range Arena for Benchmarking Efficient Transformers
Apache License 2.0
710 stars 77 forks source link

Perceiver on LRA #40

Open Muennighoff opened 3 years ago

Muennighoff commented 3 years ago

Did anybody try out the Perceiver model on LRA? It should be fairly easy to fit into this codebase, as both are written in jax I'd be super curious to see the results it'll produce