search

NOAA-ORR-ERD / LibGOODS

Library for accessing data useful for the NOAA / GNOME model
https://libgoods.readthedocs.io/en/latest/
Other
1 stars 2 forks source link

Derived datasets #6

Closed kthyng closed 2 years ago

kthyng commented 2 years ago

The main changes of this PR are to add "derived dataset" capability to the intake catalogs, also called "dataset transforms". This is used for two things:

  1. a few datasets cannot be read in successfully without an additional command. In particular, the CBOFS hindcast model output has the calendar encoded incorrectly so it has to be first read in with keyword decode_times=False and then can subsequently be read in correctly by changing the calendar and then applying the cf decoding from xarray.
  2. Variable name mappings are included in the model catalog files now and these are applied in the transform so that when a dataset is read in, the variables that NOAA needs already have these attributes added as standard names for the variables.

These steps are applied in process.py.

Tests, docs, and the demo have been updated accordingly.