Open adagj opened 1 year ago
Hi @adagj
Some files are cmorized, but some others always fail. I have attempted for quite a few times.
Typically, the error is like:
for 1i1ip2f1
! Error: NetCDF Error (-101: NetCDF: HDF error) leaving definition mode for file /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-ssp119/v20230616//ccb_Amon_NorESM2-LM_esm-ssp119_r1i1p1f2_gnqvGWL3798931.nc
!
!!!!!!!!!!!!!!!!!!!!!!!!!^[[0m
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
^[[2;31;47mC Traceback:
! In function: cmor_create_var_attributes
! ^[[0m
^[[1;31;47m!!!!!!!!!!!!!!!!!!!!!!!!!
!
! Error: NetCDF Error (-101: NetCDF: HDF error) leaving definition mode for file /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-ssp119/v20230616//cfc12global_Amon_NorESM2-LM_esm-ssp119_r1i1p1f2_gm6whzcC798934.nc
for r2i1p2f1
!
[ipcc:847687] 7 more processes have sent help message help-mtl-ofi.txt / OFI call fail
[ipcc:847687] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
^[[2;31;47mC Traceback:
! In function: cmor_create_var_attributes
!
! Error: NetCDF Error (-101: NetCDF: HDF error) leaving definition mode for file /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-ssp119/v20230616//cct_Amon_NorESM2-LM_esm-ssp119_r2i1p1f2_gncCXfF0847699.nc
!
! Error: NetCDF Error (-101: NetCDF: HDF error) leaving definition mode for file /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-ssp119/v20230616//cct_Amon_NorESM2-LM_esm-ssp119_r2i1p1f2_gncCXfF0847699.nc
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
The overview of unfinished/finished datasets are:
variant: r1i1p1f2
Ofx, fx, etc 10
yyyy1 yyyy2 nf
2101 2109 378
2110 2119 378
2120 2129 378
2130 2139 378
2140 2149 378
2150 2159 378
2160 2169 378
2170 2179 378
2180 2189 378
2190 2199 378
2200 2209 378
2210 2219 378
2220 2229 378
2230 2239 265
2240 2249 0
2250 2259 0
2260 2269 0
2270 2279 0
2280 2289 0
2290 2299 0
Total: 5189
Total r1i1p1f2: 5189
variant: r2i1p1f2
Ofx, fx, etc 6
yyyy1 yyyy2 nf
2101 2109 204
2110 2119 0
2120 2129 0
2130 2139 0
2140 2149 0
2150 2159 0
2160 2169 0
2170 2179 0
2180 2189 0
2190 2199 0
2200 2209 0
2210 2219 0
2220 2229 0
2230 2239 0
2240 2249 0
2250 2259 0
2260 2269 0
2270 2279 0
2280 2289 0
2290 2299 0
Total: 210
Total r2i1p1f2: 210
variant: r3i1p1f2
Ofx, fx, etc 10
yyyy1 yyyy2 nf
2101 2109 378
2110 2119 378
2120 2129 378
2130 2139 378
2140 2149 378
2150 2159 378
2160 2169 378
2170 2179 378
2180 2189 378
2190 2199 378
2200 2209 378
2210 2219 378
2220 2229 378
2230 2239 378
2240 2249 378
2250 2259 378
2260 2269 378
2270 2279 0
2280 2289 0
2290 2299 0
Total: 6436
Total r3i1p1f2: 6436
I would like to pass all the recipes to you, and you can just try to execute the program at your side. I assume you just need to copy my recipes to your home folder (or else) and invoke the script. I can tell more if you agree with this. Sorry for this!
No problem! Thanks for all your efforts!! Please send everything to me and I'll do my best :-)
No problem! Thanks for all your efforts!! Please send everything to me and I'll do my best :-)
Thank you :-)
I send you a separate mail with some more details.
Mandatory information:
Full path to the case(s) of the experiment on NIRD /projects/NS10013K/noresm/cases
experiment_id
esm-ssp119
model_id
NorESM2-LM
CASENAME(s) and years to be CMORized
NSSP119frc2extesm_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299 NSSP119frc2extesm_1901_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299 NSSP119frc2extesm_1951_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299
Optional information
(additional information, if the experiment is branched/hybrid restart from previous parent experiment; you may find more information relevant to the experiment_id here: https://github.com/NorESMhub/noresm2cmor/blob/master/tables/CMIP6_CV.json)
These are continuations of the three first ensemble members of esm-ssp119
There already exis some NorESM2-LM experiments for the years 2101-2299 (e.g. https://github.com/NorESMhub/noresm2cmor/issues/339) with different treatment of the aerosol emissions. They use constant anthropogenic aerosol emissions after 2100, following O'Neill 2016 (https://gmd.copernicus.org/articles/9/3461/2016/) while in these simulations we change the aerosol emissions following Meinshausen 2020 (https://gmd.copernicus.org/articles/13/3571/2020/) which is a linear phase out of non-biomass aerosols by 2250. The biomass aerosols are kept constant from 2100 and onward. I therefor suggest we name these 3 members with f2 as forcing realization
r1i1p1f2: NSSP119frc2extesm_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299 r2i1p1f2: NSSP119frc2extesm_1901_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299 r3i1p1f2: NSSP119frc2extesm_1951_f19_tn14_lineardecrease2250_20230927, years 2101 - 2299
parent_experiment_id
esm-ssp119 (not really the parent, maybe that should be esm-hist)
parent_experiment_rip
r1i1p1f1 r2i1p1f1 r3i1p1f1
The parents are: For the years 2015-2100: /projects/NS10013K/noresm/cases/NSSP119frc2esm_1850_f19_tn14_20230818, 2015-2100, esm-ssp119, r1i1p1f1 /projects/NS10013K/noresm/cases/NSSP119frc2esm_1901_f19_tn14_20230818, 2015-2100, esm-ssp119, r2i1p1f1 /projects/NS10013K/noresm/cases/NSSP119frc2esm_1951_f19_tn14_20230818, 2015-2100, esm-ssp119, r3i1p1f1
For the esm-hist parents: /projects/NS9560K/noresm/cases/NHIST_f19_tn14_20191104esm: esm-hist, r1i1p1f1 /projects/NS10013K/noresm/cases/NHIST_1901_f19_tn14_20230201esm: esm-hist, r2i1p1f1 /projects/NS10013K/noresm/cases/NHIST_1951_f19_tn14_20230201esm: esm-hist, r3i1p1f1
parent_time_units
e.g., 'days since 0421-01-01'
branch_method
'branch from esm-ssp119 year 2101'
other information
(provide other information that might be useful) e.g., realisation, initialisation, etc...
NSSP119frc2extesm_f19_tn14_lineardecrease2250_20230927: branched from /projects/NS10013K/noresm/cases/NSSP119frc2esm_1850_f19_tn14_20230818 , year 2101 NSSP119frc2extesm_1901_f19_tn14_lineardecrease2250_20230927: branched from /projects/NS10013K/noresm/cases/,NSSP119frc2esm_1901_f19_tn14_20230818 year 2101 NSSP119frc2extesm_1951_f19_tn14_lineardecrease2250_20230927: branched from /projects/NS10013K/noresm/cases/NSSP119frc2esm_1951_f19_tn14_20230818, year 2101