amazon-science / earth-forecasting-transformer

Official implementation of Earthformer
Apache License 2.0
359 stars 61 forks source link

Memory issues with the earthformer runtime #66

Open fizzking opened 8 months ago

fizzking commented 8 months ago

I set the dimension as (2000,131,21,1), that is, (T,H,W,C) the data input model can run, (the monitor shows that the runtime code takes up 13GB), but when increasing the timing, that is, expanding to (4000,131,21,1), the memory is insufficient. My GPU is 24GB and the batch size is set to 2, I wonder if this is because the earthformer model itself takes up a lot of memory at runtime?

gaozhihan commented 8 months ago

As the shape of the data increases, the memory costs also increase.