Closed adamsolomou closed 3 years ago
Configs for reproducing the results are now available at: https://github.com/google-research/long-range-arena/tree/main/lra_benchmarks/text_classification/configs
Feel free to reopen the issue if there was any further questions.
Hi, for the byte-level document classification task there seems to be a discrepancy between the paper (see Appendix 1.2) and the config file in the repository.
Paper
6 layers, 8 heads, 512 hidden dimensions, d=2048 for positional FFN
Code
Could you please resolve this?
This is also the case for other tasks, e.g. Image Classification