NVIDIA / earth2mip

Earth-2 Model Intercomparison Project (MIP) is a python framework that enables climate researchers and scientists to inter-compare AI models for weather and climate.
https://nvidia.github.io/earth2mip/
Apache License 2.0
187 stars 41 forks source link

🚀[FEA]: Making scoring resumable #95

Open nbren12 opened 10 months ago

nbren12 commented 10 months ago

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem you would like to solve.

Scoring large models is an expensive workload, and sometimes cannot be completed in a single session. It would be nice to make both lagged ensembles and medium range resumable.

Alternatively could add a --n-shard --shard flags to the medium range inference scripts to make the problem size small enough to complete in one session.

This is blocking graphcast scoring.

Describe any alternatives you have considered

No response