search

NCAR / CUPiD

CUPiD is a “one stop shop” that enables and integrates timeseries file generation, data standardization, diagnostics, and metrics from all CESM components.
https://ncar.github.io/CUPiD/
Apache License 2.0
21 stars 19 forks source link

Single variable time series generation #18

Open TeaganKing opened 7 months ago

TeaganKing commented 7 months ago

This is a separate effort from Brian Dobbins and CISL that will likely also include data compression.

dabail10 commented 6 months ago

The ADF version of this works fine for the sea ice history files. Just uses ncrcat. Very quick for less than 50 years of monthly-mean data. We should probably make an xarray version that is more flexible. We would like a few features:

  1. chunking. That is for 100 years of data we could break the timeseries up into 10 year files for example.
  2. compression. The default netcdf4 lossless compression would be a good start here.
dabail10 commented 6 months ago

I have attached my customized YAML file to get this working with the sea ice history files.

config_pcwg_default_plots.yml.gz

TeaganKing commented 3 months ago

A temporary solution will be implemented with #78. We'd still like to address the features mentioned in Dave's earlier comment.

mnlevy1981 commented 2 months ago

We are intentionally leaving this issue open even though #78 has been merged because we are waiting for a more permanent solution that addresses the points raised in https://github.com/NCAR/CUPiD/issues/18#issuecomment-1865036595