Open charliepascoe opened 2 years ago
Please place the data you upload in a named version directory under the ccmi-2022 directory.
The name of the version directory should be v\
The experiment id (histSST-piNTCF) is not one of the experiments expected for the ccmi-2022 project. The list of accepted ccmi-2022 experiment names are in this json file https://github.com/cedadev/ccmi-2022/blob/main/Tables/CCMI2022_CV.json
The activity_id attribute in the netCDF files is listed as "AerChemMIP", it should be "CCMI2022"
The Conventions attribute in the netCDF files is listed as "CF-1.7 CMIP-6.2", it should be "CF-1.7"
The mip_era attribute is "CCMI2022", it should be "CMIP6"
Dear Charlotte,
should we change also the EXPID = "histSST-piNTCF" or not?
Hi @marchandmarion yes, you should change the experiment_id Options are "refD1", "refD2", "senD2-sai", "senD2-ssp126", "senD2-ssp370" https://github.com/cedadev/ccmi-2022/blob/main/Tables/CCMI2022_CV.json
Dear @charliepascoe I'm working with Marion. Before we copy the files, please could you tell me if metadata are good? The order of attributes has change a little (the ones that I have changed are written at the end), is it a problem? Many thanks in advance!
// global attributes:
:creation_date = "2021-12-25T03:16:22Z" ;
:tracking_id = "hdl:21.14100/91ca6721-ae26-4942-a9b0-76576d5aaeb7" ;
:description = "Historical WMGHG concentrations and halocarbons emissions, 1850 NTCF emissions, prescribed SSTs" ;
:title = "IPSL-CM6A-ATM-LR-REPROBUS model output prepared for CMIP6 / AerChemMIP histSST-piNTCF" ;
:contact = "ipsl-cmip6@listes.ipsl.fr" ;
:data_specs_version = "01.00.28" ;
:dr2xml_version = "1.16" ;
:experiment = "historical SSTs and historical forcing, but with pre-industrial NTCF emissions" ;
:external_variables = "areacella" ;
:forcing_index = 1 ;
:frequency = "day" ;
:further_info_url = "https://furtherinfo.es-doc.org/CCMI2022.IPSL.IPSL-CM6A-ATM-LR-REPROBUS.histSST-piNTCF.none.r1i1p1f1" ;
:grid = "LMDZ grid" ;
:grid_label = "gr" ;
:nominal_resolution = "250 km" ;
:comment = "IPSL-CM6A-ATM-LR-REPROBUS CCM simulations start at the end of the pre-industrial period, from 4 years spinup over 1956-1959 period using the same setup as current simulation" ;
:history = "Fri Apr 1 15:23:13 2022: ncrcat toz_CCMIAday_IPSL-CM6A-ATM-LR-REPROBUS_histSST-piNTCF_r1i1p1f1_gr_20100102-20150101.nc toz_CCMIAday_IPSL-CM6A-ATM-LR-REPROBUS_histSST-piNTCF_r1i1p1f1_gr_20100102-20190101.nc toz_CCMIAday_IPSL-CM6A-ATM-LR-REPROBUS_histSST-piNTCF_r1i1p1f1_gr_20100102-20190101.nc.conc\nnone" ;
:initialization_index = 1 ;
:institution_id = "IPSL" ;
:institution = "Institut Pierre Simon Laplace, Paris 75252, France" ;
:license = "CMIP6 model data produced by IPSL is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License (https://creativecommons.org/licenses). Consult https://pcmdi.llnl.gov/CMIP6/TermsOfUse for terms of use governing CMIP6 output, including citation requirements and proper acknowledgment. Further information about this data, including some limitations, can be found via the further_info_url (recorded as a global attribute in this file) and at https://cmc.ipsl.fr/. The data producers and data providers make no warranty, either express or implied, including, but not limited to, warranties of merchantability and fitness for a particular purpose. All liabilities arising from the supply of the information (including any liability arising in negligence) are excluded to the fullest extent permitted by law." ;
:physics_index = 1 ;
:product = "model-output" ;
:realization_index = 1 ;
:realm = "atmos" ;
:source = "IPSL-CM6A-ATM-LR-REPROBUS (2021): aerosol: REPROBUS v6 atmos: LMDZ (NPv6 ; 144 x 143 longitude/latitude; 79 levels; top level 80000 m)" ;
:source_id = "IPSL-CM6A-ATM-LR-REPROBUS" ;
:source_type = "AGCM AER" ;
:sub_experiment_id = "none" ;
:sub_experiment = "none" ;
:table_id = "CCMIAday" ;
:variable_id = "toz" ;
:variant_label = "r1i1p1f1" ;
:CMIP6_CV_version = "cv=6.2.15.1" ;
:dr2xml_md5sum = "407f8bd269801ca09fc1b64f6807a16f" ;
:model_version = "6.2" ;
:NCO = "\"4.6.0\"" ;
:nco_openmp_thread_number = 1 ;
:Conventions = "CF-1.7" ;
:activity_id = "CCMI2022" ;
:experiment_id = "refD1" ;
:mip_era = "CMIP6" ;
:EXPID = "refD1" ;
:name = "" ;
Hi @LolaFalletti I apologise for not noticing this question. The metadata is good except for the table_id "CCMIAday" which should be "Aday". I will correct this for the data that has been uploaded to v20220607 but you should correct the table_id attribute for any future uploads. best wishes, Charlotte
Notes for Charlotte:
I'm copying the v20220607 data to the processing area.
Once the data has finished copying I will create file lists by mip table e.g.
find . -type f -name "*AmonZ*nc" > AmonZfiles.txt
Then I can use these file lists as input to the ncatted command as follows:
xargs -l ncatted -O -a table_id,global,o,c,AmonZ < AmonZfiles.txt
The v20220607 data is being ingested into the CEDA archive. You will see your data appearing here https://dap.ceda.ac.uk/badc/ccmi/data/post-cmip6/ccmi-2022/IPSL-LATMOS/
Thank you!
All files have an incorrectly named mip table information in the file name. e.g. br_CCMIAmonZ_IPSL-CM6A-ATM-LR-REPROBUS_histSST-piNTCF_r1i1p1f1_grz_196001-198412.nc In this instance the mip table information should simply be AmonZ