search

cedadev / ccmi-2022

CCMI-2022 - in support of the WMO/UNEP Scientific Assessment of Ozone Depletion Report 2022
BSD 2-Clause "Simplified" License
0 stars 4 forks source link

omorgenstern ceda-cc report for NIWA-UKCA2 v20210712 #29

Closed charliepascoe closed 3 years ago

charliepascoe commented 3 years ago

"error count 3" example 2021-07-26 21:03:43,705 INFO Starting batch -- number of file: 1 2021-07-26 21:03:43,705 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210712/r3i1p1f1/o3strat_Amon_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-07-26 21:03:43,706 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210712/r3i1p1f1/o3strat_Amon_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-07-26 21:03:43,714 INFO Python netcdf: netCDF4 2021-07-26 21:03:43,715 INFO Starting: o3strat_Amon_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-07-26 21:03:43,715 INFO Starting file o3strat_Amon_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-07-26 21:03:43,715 INFO C4.001.001: [parse_filename]: OK 2021-07-26 21:03:43,715 INFO C4.001.002: [parse_filename_timerange]: OK 2021-07-26 21:03:43,715 INFO C4.001.004: [file_name_extra]: OK 2021-07-26 21:03:43,829 INFO C4.002.001: [global_ncattribute_present]: OK 2021-07-26 21:03:43,830 INFO C4.002.003: [variable_type]: OK 2021-07-26 21:03:43,830 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-07-26 21:03:43,830 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-07-26 21:03:43,830 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-07-26 21:03:43,830 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [o3strat] has incorrect attributes: long_name="Mole Fraction of Stratospheric Ozone" [correct: "Stratospheric Ozone Tracer Volume Mixing Ratio"]; standard_name="mole_fraction_of _stratospheric_ozone" [correct: ""] 2021-07-26 21:03:43,830 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('product', 'model_output', "['model-output']"), ('realization_index', '3', "Value is not instance of required class: 3 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-07-26 21:03:43,830 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-07-26 21:03:43,830 INFO C4.003.001: [time_attributes]: OK 2021-07-26 21:03:43,830 INFO Done -- error count 3

charliepascoe commented 3 years ago

[variable_ncattribute_mipvalues]: FAILED:: Variable [o3strat] has incorrect attributes: standard_name="mole_fraction_of_ozone_in_air" [correct: ""] This ceda-cc error occurs for ccmi-2022 variables that do not have standard names. The standard name attribute for these variables should be present but left empty, e.g. o3strat:standard_name = ""

charliepascoe commented 3 years ago

[variable_ncattribute_mipvalues]: FAILED:: Variable [o3strat] has incorrect attributes: long_name="Mole Fraction of Stratospheric Ozone" [correct: "Stratospheric Ozone Tracer Volume Mixing Ratio"] The long_name doesn't match the string that is expected for this variable in the Amon MIP table. This error is only found in the o3strat data files.

charliepascoe commented 3 years ago

[variable_ncattribute_mipvalues]: FAILED:: cell_methods="longitude:mean time: mean" [correct: "longitude: mean time: mean"] This error is cropping up because the qc code expects to find a space between "longitude:" and "mean" in the cell_methods attribute. I can correct this here at CEDA. #28 This error is present in some of the data files in this upload.

charliepascoe commented 3 years ago

[global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: ('product', 'model_output', "['model-output']") This error is likely due to a typo, the cv expects product to be "model-output" with a hyphen, but "model_output" with an underscore has been provided. This error seems to be present in all the data files in this upload.

charliepascoe commented 3 years ago

[global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('realization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] This error is because you have provided the ripf indices as strings and not integers. A correct usage example would be: :physics_index = 1 ; This error seems to be present in all the data files in this upload.

charliepascoe commented 3 years ago

[filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes This does not need to be corrected. I believe that this error is due to a problem with how the ceda-cc quality control software is processing the ccmi-2022 filenames.

charliepascoe commented 3 years ago

tar ball of the full ceda-cc output v20210712ceda-cc.tar.gz

charliepascoe commented 3 years ago

[variable_ncattribute_mipvalues]: FAILED:: Variable [o3strat] has incorrect attributes: standard_name="mole_fraction_of_ozone_in_air" [correct: ""] This ceda-cc error occurs for ccmi-2022 variables that do not have standard names. The standard name attribute for these variables should be present but left empty, e.g. o3strat:standard_name = ""

The netCDF library that Olaf uses won't allow the standard name field to be blank, instead he will omit the field.

charliepascoe commented 3 years ago

The data is going to be reprocessed by Olaf and re-uploaded