search

nextGEMS / catalog

Intake catalog for nextgems
5 stars 7 forks source link

Update main.yaml #93

Closed Zarnosch closed 2 months ago

Zarnosch commented 3 months ago

missing NaN values are corrected in the dataset itself, therefore the catalog can point back to the original data

Zarnosch commented 3 months ago

For PT3H plenty of variables do not contain any data for zoom 10, tas is one of those empty variables. For PT15M zoom 10 there is no data at all, so that set could be removed all together. If everyone agrees, I can delete everything that does not contain any data. I do not know if intake/xarray needs those empty dummy variables.

florianziemen commented 3 months ago

If a variable is not listed in the .zmetadata and the .zarray / ... then xarray should not expect to find it. The Intake catalog has no idea which variables should be available, and from an xarray point of view, all dataset variants are independent, as far as I can tell. Maybe use a git repo to track the changes you are doing...