cedadev / ccmi-2022

CCMI-2022 - in support of the WMO/UNEP Scientific Assessment of Ozone Depletion Report 2022
BSD 2-Clause "Simplified" License
0 stars 4 forks source link

temporary acceptance of filename_filemetadata_consistency error #32

Closed charliepascoe closed 3 years ago

charliepascoe commented 3 years ago

ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')]

Unfortunately the data we tested ceda-cc with had the variant_label and grid_label filename segments in the wrong order. Until ceda-cc is updated we should allow this kind of error to pass.

More on this at https://github.com/cedadev/ceda-cc/issues/14

charliepascoe commented 3 years ago

I'm running qc on data and reviewing the results in batches (rather than checking each file as it is ingested). The ingest can then be run on batches of data, my review considers whether data has passed the checks and then ingests in batches (without running checks).