Empty NETCDF files - Githubissues

JGCRI / CMIP6

documentation and processing code for JGCRI's CMIP6 archive on pic

4 stars 1 forks source link

Empty NETCDF files #17

Closed kdorheim closed 4 years ago

kdorheim commented 4 years ago

It turns out that some of the netcdf files that have been downloaded are ... empty! Whether this is an issue with the cmip6 portals or occurred during an incomplete download this is horrendous and must be correct.

[x] Need to go through the current files and remove any file that is not a netcdf format
[x] Add/implement some sort of quality check for the netcdf files before adding them to to the archive

kdorheim commented 4 years ago

With commit 491880d there is a cleanup-arhcive.sh that does some quality control for the archive and quality measures have been added to the ETHZ download script/instructions.

abigailsnyder commented 4 years ago

/pic/projects/GCAM/CMIP6/archive/tos/tos_Omon_IPSL-CM6A-LR_ssp245_r1i1p1f1_gn_201501-210012.nc may be one of these files. When trying to regrid on pic, error cdo remapbil (Abort): Unsupported grid type: generic is returned.