[CMIP6 CMOR-ization & ESGF-publication] NorESM2-LM - esm-hist

[adagj]

Mandatory information:

Full path to the case(s) of the experiment on NIRD /projects/projects/NS10013K/noresm/cases/

experiment_id esm-hist

model_id NorESM2-LM

CASENAME(s) and years to be CMORized NHIST_1901_f19_tn14_20230201esm, 1850-2014

Optional information

2nd realization, r2i1p1f1, aerosol history output

parent_experiment_id esm-piControl

parent_experiment_rip r1i1p1f1

parent_time_units parent_time_units = "days since 1851-01-01" parent_time_units = "days since 1751-01-01"

branch_method 'Hybrid-restart from year 1901-01-01 of esm-piControl',

other information (provide other information that might be useful) 2nd realization, hybrid restart from /projects/NS9560K/noresm/cases/N1850_f19_tn14_20190730esm at year 1901-01-01

update, 2023.06.26 the esm-picontrol should be: /projects/NS2345K/noresm/cases/N1850_f19_tn14_20190730esm

[YanchunHe]

I made some corrections to the experiment configuration above.

This applies to issue #328, #329, #330, #331, #332, #333, #334, #334

[YanchunHe]

Hi @adagj

I see the number of cmorized datasets (variables) are slightly different from different realisations and periods. Is that expected?

For example,

• 529 different datasets during 1850-1959 (or 1949), and 757 datasets during 1960-2014 for r2i1p1f1.
• 529 datasets for all the periods of r3i1p1f1.
• 440 datasets for all (not finished yet) periods of r5i1p1f1.
• 486 datasets for some other realisations.

[adagj]

Hi @YanchunHe

I would expect more output for r2i1p1f1, r3i1p1f1, r4i1p1f1 becouse they are run with extensive aerosol output. But I would expect the same amount of output for all years and all 3. And the same for the remaining r5 - r10.

I will have a look and let you know if I find something.

Best, Ada

[YanchunHe]

Seems like there are something unusual with time axies the yearly hamocc output. So that, for example:

cd /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-hist/v20230616
$ ls -1 bfe_Oyr*r2i1p1f1*.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1861-1861.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1874-1874.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1899-1899.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1910-1910.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1923-1923.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1946-1946.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1951-1957.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1960-1969.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1971-1979.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1980-1989.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_1990-1999.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_2000-2009.nc
bfe_Oyr_NorESM2-LM_esm-hist_r2i1p1f1_gr_2010-2014.nc

Those from the ~1960/1970 of Oyr datasets do not include the 10 years record, as expected.

I have not checked the raw output though.

[adagj]

@YanchunHe I'm not sure which files you use for the cmorization, but seems like all the files are in the case folder, but maybe something happen while archiving... can you try to rerun the cmorization just the first 30 years? Will that work you think?

[YanchunHe]

For example:

yanchun@ipcc:/projects/NS10013K/noresm/cases/NHIST_1901_f19_tn14_20230201esm/ocn/hist
$ ls *hbgcy.*
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1861.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1874.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1899.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1910.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1923.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1946.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1951.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1952.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1953.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1957.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1960.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1963.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1967.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1969.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1971.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1972.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1975.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1976.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1977.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1978.nc
NHIST_1901_f19_tn14_20230201esm.blom.hbgcy.1979.nc
...

Seems many years are missing.

Could you check other 'realisations' too?

[adagj]

Thanks @YanchunHe for checking. That's not good at all... I'll do some more digging, maybe I need to rerun some parts

[YanchunHe]

Thanks @YanchunHe for checking. That's not good at all... I'll do some more digging, maybe I need to rerun some parts

Yes, would be nice to check first if all years have the same number of output files.

[adagj]

I made some corrections to the experiment configuration above.

This applies to issue #328, #329, #330, #331, #332, #333, #334, #334

Hi, N1850_f19_tn14_20190730esm is stored in two places; NS2345K (years 1850-2200) and NS9560K (years 2200-2310)

[adagj]

@YanchunHe I think it is easier to have all the information in one issue, so I started a new one here: https://github.com/NorESMhub/noresm2cmor/issues/348

[YanchunHe]

CMORized, and ready to be published to ESGF.

There are more files/datasets for years from 1980-2014. 529 datasets for every 10 years before 1980, and 575 afterwards.

data path

• /projects/NS9034K/CMIP6/.cmorout/NorESM2-LM/esm-hist
• /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/esm-hist

version

• v20230616

sha256sum /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/esm-hist

• .r2i1p1f1.sha256sum_v20230616

[monsieuralok]

@YanchunHe are r2 to r10 realisation having different number of datasets? as sha256sum files differs a lot quite in size as .r4i1p1f1_20231003.map 3158102 bytes while .r5i1p1f1_20231003.map 2625378 bytes.

[YanchunHe]

corrected: Here are the corrected list of number of files per realisation:

variant: r2i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    529
1860    1869    529
1870    1879    529
1880    1889    529
1890    1899    529
1900    1909    529
1910    1919    529
1920    1929    529
1930    1939    529
1940    1949    529
1950    1959    529
1960    1969    529
1970    1979    529
1980    1989    575
1990    1999    575
2000    2009    575
2010    2014    575
Total:      9187
Total r2i1p1f1: 9187
Shasum lines:   9187

variant: r3i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    529
1860    1869    529
1870    1879    529
1880    1889    529
1890    1899    529
1900    1909    529
1910    1919    529
1920    1929    529
1930    1939    529
1940    1949    529
1950    1959    529
1960    1969    529
1970    1979    529
1980    1989    529
1990    1999    529
2000    2009    529
2010    2014    529
Total:      9003
Total r3i1p1f1: 9003
Shasum lines:   9003

variant: r4i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    529
1860    1869    529
1870    1879    529
1880    1889    529
1890    1899    529
1900    1909    529
1910    1919    529
1920    1929    529
1930    1939    529
1940    1949    529
1950    1959    529
1960    1969    529
1970    1979    529
1980    1989    529
1990    1999    529
2000    2009    529
2010    2014    529
Total:      9003
Total r4i1p1f1: 9003
Shasum lines:   9003

variant: r5i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    440
1860    1869    440
1870    1879    440
1880    1889    440
1890    1899    440
1900    1909    440
1910    1919    440
1920    1929    440
1930    1939    440
1940    1949    440
1950    1959    440
1960    1969    440
1970    1979    440
1980    1989    440
1990    1999    440
2000    2009    440
2010    2014    440
Total:      7490
Total r5i1p1f1: 7490
Shasum lines:   7490

variant: r6i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    486
1860    1869    486
1870    1879    486
1880    1889    486
1890    1899    486
1900    1909    486
1910    1919    486
1920    1929    486
1930    1939    486
1940    1949    486
1950    1959    486
1960    1969    486
1970    1979    486
1980    1989    486
1990    1999    486
2000    2009    486
2010    2014    486
Total:      8272
Total r6i1p1f1: 8272
Shasum lines:   8272

variant: r7i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    486
1860    1869    486
1870    1879    486
1880    1889    486
1890    1899    486
1900    1909    486
1910    1919    486
1920    1929    486
1930    1939    486
1940    1949    486
1950    1959    486
1960    1969    486
1970    1979    486
1980    1989    486
1990    1999    486
2000    2009    486
2010    2014    486
Total:      8272
Total r7i1p1f1: 8272
Shasum lines:   8272

variant: r8i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    486
1860    1869    486
1870    1879    486
1880    1889    486
1890    1899    486
1900    1909    486
1910    1919    486
1920    1929    486
1930    1939    486
1940    1949    486
1950    1959    486
1960    1969    486
1970    1979    486
1980    1989    486
1990    1999    486
2000    2009    486
2010    2014    486
Total:      8272
Total r8i1p1f1: 8272
Shasum lines:   8272

variant: r9i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    486
1860    1869    486
1870    1879    486
1880    1889    486
1890    1899    486
1900    1909    486
1910    1919    486
1920    1929    486
1930    1939    486
1940    1949    486
1950    1959    486
1960    1969    486
1970    1979    486
1980    1989    486
1990    1999    486
2000    2009    486
2010    2014    486
Total:      8272
Total r9i1p1f1: 8272
Shasum lines:   8272

variant: r10i1p1f1
Ofx, fx, etc    10
yyyy1   yyyy2   nf
1850    1859    486
1860    1869    486
1870    1879    486
1880    1889    486
1890    1899    486
1900    1909    486
1910    1919    486
1920    1929    486
1930    1939    486
1940    1949    486
1950    1959    486
1960    1969    486
1970    1979    486
1980    1989    486
1990    1999    486
2000    2009    486
2010    2014    486
Total:      8272
Total r10i1p1f1:    8272
Shasum lines:   8272

[monsieuralok]

@YanchunHe I am mentioning number of lines from nird:

.r2i1p1f1.sha256sum_v20230616 - 9187 .r3i1p1f1.sha256sum_v20230616 - 9003 .r4i1p1f1.sha256sum_v20230616 - 9003 .r5i1p1f1.sha256sum_v20230616 - 7490 .r6i1p1f1.sha256sum_v20230616 - 8272 .r7i1p1f1.sha256sum_v20230616 - 8272 .r8i1p1f1.sha256sum_v20230616 - 8272 .r9i1p1f1.sha256sum_v20230616 - 8272 .r10i1p1f1.sha256sum_v20230616 - 8272

which are different what you mentioned.

[YanchunHe]

OK, I will check.

[YanchunHe]

I past the wrong number of files.. just in the above thread. I will update soon.

[YanchunHe]

@YanchunHe I am mentioning number of lines from nird:

.r2i1p1f1.sha256sum_v20230616 - 9187 .r3i1p1f1.sha256sum_v20230616 - 9003 .r4i1p1f1.sha256sum_v20230616 - 9003 .r5i1p1f1.sha256sum_v20230616 - 7490 .r6i1p1f1.sha256sum_v20230616 - 8272 .r7i1p1f1.sha256sum_v20230616 - 8272 .r8i1p1f1.sha256sum_v20230616 - 8272 .r9i1p1f1.sha256sum_v20230616 - 8272 .r10i1p1f1.sha256sum_v20230616 - 8272

which are different what you mentioned.

So, these are right numbers.

I don't see anything wrong.

Please clarify me if you have more in doubt.

Thanks:-)

[monsieuralok]

@YanchunHe published