search

google-research / long-range-arena

Long Range Arena for Benchmarking Efficient Transformers
Apache License 2.0
710 stars 77 forks source link

Script for computing memory consumption #32

Open maximzubkov opened 3 years ago

maximzubkov commented 3 years ago

Hello again!

I succeeded to run your code on my devices, but now I am struggling with computing memory consumption. Could you please opensource script for computing it?

MostafaDehghani commented 3 years ago

Unfortunately, the memory consumptions reported in the paper are calculated using a google internal tool which is not open-sourced. We will check with the internal teams to see if there is an alternative open-sourced version of that available.