cedadev / ccmi-2022

CCMI-2022 - in support of the WMO/UNEP Scientific Assessment of Ozone Depletion Report 2022
BSD 2-Clause "Simplified" License
0 stars 4 forks source link

dplummer ceda-cc report for CMAM v20210311 #26

Open charliepascoe opened 3 years ago

charliepascoe commented 3 years ago

"error count 3" example 2021-07-21 19:05:12,670 INFO Starting batch -- number of file: 1 2021-07-21 19:05:12,670 INFO Source: /datacentre/arrivals/users/dplummer/ccmi-2022a/v20210311/sadice_AmonZ_CMAM_refD1_r1i1p1f1_gnz_196001-201812.nc 2021-07-21 19:05:12,670 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/dplummer/ccmi-2022a/v20210311/sadice_AmonZ_CMAM_refD1_r1i1p1f1_gnz_196001-201812.nc 2021-07-21 19:05:12,678 INFO Python netcdf: netCDF4 2021-07-21 19:05:12,679 INFO Starting: sadice_AmonZ_CMAM_refD1_r1i1p1f1_gnz_196001-201812.nc 2021-07-21 19:05:12,679 INFO Starting file sadice_AmonZ_CMAM_refD1_r1i1p1f1_gnz_196001-201812.nc 2021-07-21 19:05:12,679 INFO C4.001.001: [parse_filename]: OK 2021-07-21 19:05:12,679 INFO C4.001.002: [parse_filename_timerange]: OK 2021-07-21 19:05:12,679 INFO C4.001.004: [file_name_extra]: OK 2021-07-21 19:05:12,776 INFO C4.002.001: [global_ncattribute_present]: OK 2021-07-21 19:05:12,776 INFO C4.002.003: [variable_type]: OK 2021-07-21 19:05:12,776 ERROR C4.002.004: [variable_ncattribute_present]: FAILED:: Required variable attributes missing: ['standard_name'] 2021-07-21 19:05:12,776 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-07-21 19:05:12,776 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-07-21 19:05:12,776 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-07-21 19:05:12,777 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('source_type', 'AGCM CHEM', "['AER', 'AGCM', 'AOGCM', 'BGC']")] 2021-07-21 19:05:12,777 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-07-21 19:05:12,777 INFO C4.003.001: [time_attributes]: OK 2021-07-21 19:05:12,777 INFO Done -- error count 3

charliepascoe commented 3 years ago

[variable_ncattribute_present]: FAILED:: Required variable attributes missing: ['standard_name'] This ceda-cc error occurs for ccmi-2022 variables that do not have standard names. My understanding from the cv is that the standard name attribute for these variables should be present but left empty, e.g. sadice:standard_name = "" but the quality control will allow these variables to have no standard name attribute so if the standard name isn't present it will nevertheless be ingested.

charliepascoe commented 3 years ago

[global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('source_type', 'AGCM CHEM', "['AER', 'AGCM', 'AOGCM', 'BGC']")] I think the source_type should just be CHEM. "CHEM": "chemistry treatment in an atmospheric model that calculates atmospheric oxidant concentrations (including at least ozone), rather than prescribing them",

charliepascoe commented 3 years ago

[filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes This does not need to be corrected. I believe that this error is due to a problem with how the ceda-cc quality control software is processing the ccmi-2022 filenames.

charliepascoe commented 3 years ago

tar ball of the full ceda-cc output v20210311ceda-cc.tar.gz