NOAA-EMC / RTOFS_GLO

0 stars 1 forks source link

Add in checks for corrupted hdf5 input files to avoid jrtofs_global_ncoda_qc job failure (bugzilla 1491) #38

Open DanIredell-NOAA opened 1 year ago

DanIredell-NOAA commented 1 year ago

http://www2.spa.ncep.noaa.gov/bugzilla/show_bug.cgi?id=1491

There was a failure for this job 7/22/2023 for a corrupted hdf5 input file:

/prod/primary/00/rtofs/v2.3/da/jrtofs_global_ncoda_qc

in: $DCOMROOT/$PDY/wtxtbul/satSSS/SMAP

file: 20230721/wtxtbul/satSSS/SMAP/SMAP_L2B_SSS_NRT_45228_A_20230721T010436.h5

There needs to be a check and way to bypass these files so the model doesn't fail. For now pending this failure frequency, this can be for the next planned upgrade given.

DanIredell-NOAA commented 1 year ago

As with netcdf file where a ncdump was called to check if the file was readable, in this case h5dump will need to be called for hdf files to check for readability.