google-research / long-range-arena

Long Range Arena for Benchmarking Efficient Transformers
Apache License 2.0
710 stars 77 forks source link

Question regarding model checkpoint #59

Open LeoXinhaoLee opened 1 year ago

LeoXinhaoLee commented 1 year ago

Hi, thank you so much for releasing code for this solid work!

I noticed the config.restore_checkpoints flag in all config files is set to True. Does this mean this codebase should only run with a pre-trained model? Or we could simply set that flag to False and train our own models from scratch on this benchmark?

Thank you so much for your time and help!