Skip and continue loop if you see lon.nc or similar

NOAA-GFDL / CatalogBuilder

Toolset to build, validate, modify, and use intake-esm based data catalogs

2 stars 1 forks source link

Skip and continue loop if you see lon.nc or similar #39

Open aradhakrishnanGFDL opened 1 month ago

aradhakrishnanGFDL commented 1 month ago

For the experiment, there are files like lon.nc which need to be skipped while cataloguing. It produces a traceback without any info..or "continue" state. The fix is to skip such files, but not compromise on statics.

Skipping lon.nc

aradhakrishnanGFDL commented 1 month ago

we compare the length of the filaname (TODO: split by . - hence the same logic needs to be modified for underscore delimiters for cmip with the output_file_name_template in config file and skip if they do not match

aradhakrishnanGFDL commented 1 month ago

addresses most of https://github.com/NOAA-GFDL/MDTF-diagnostics/issues/667 unless new issues are reported.