Long Range Arena Benchmark

[CJcool06]

The goal of this project is to take a step toward a pipeline for implementing and evaluating my ideas. This will be my first time doing this.

• [ ] Read the paper
• [ ] Look at the repository
• [ ] Finish implementation of the vanilla transformer
• [ ] Test the vanilla transformer on the benchmark