ECMWFCode4Earth / ml_drought

Machine learning to better predict and understand drought. Moving github.com/ml-clim
https://ml-clim.github.io/drought-prediction/
92 stars 18 forks source link

Memory Error when loading training arrays into memory #38

Closed gabrieltseng closed 5 years ago

gabrieltseng commented 5 years ago

Now that we are including the GLEAM dataset in our training data, the data is too large to fit into memory.

The solution is probably a dataloader, but this makes normalization more tricky.