search

CH-Earth / datatool

datatool: Dynamical Data Processing Tool for HPCs
GNU General Public License v3.0
9 stars 4 forks source link

Script and documentation of `AMES NEX-GDDP-CMIP6` dataset #27

Closed kasra-keshavarz closed 8 months ago

kasra-keshavarz commented 1 year ago

Problem

The AMES NEX-GDDP-CMIP6 dataset needs to be added to the list of scripts. The dataset consists of ~30TBs of data and needs contains various climate models, each containing a few ensemble members, variables, and time-scales.

The calendar of each dataset may be different from others; something to be mindful about.

Enhancements required

Parallelization scheme for submitting jobs based on "models," SHOULD be implemented. This feature will be optional, as not all datasets, consist of various "models."

kasra-keshavarz commented 1 year ago

Related to #25

kasra-keshavarz commented 8 months ago

Resolved with #43