Once nuopc/cmeps cases work on izumi, add some testing

billsacks commented 2 years ago

Once nuopc/cmeps cases work on izumi, I feel that we should add the following tests to the test suite:

NUOPC versions of all of the current izumi tests
Some Antarctica tests similar to existing Greenland tests; I'd suggest:
- SMS_Vnuopc_D_Ly1_P24x1.f09_g17_ais8.T1850Ga.izumi_nag
- SMS_Vnuopc_D_Ld5_P24x1.f10_f10_ais8_mg37.I1850Clm50SpGa.izumi_nag.cism-test_coupling
- SMS_Vnuopc_D_Ly1_P24x1.f09_g17_ais8.T1850Ga.izumi_pgi

billsacks commented 2 years ago

I have mostly addressed this in ba968a85 and 0974261b. The remaining need is nuopc pgi tests, once pgi is working with nuopc: see the two comments referring to BUG(wjs, 2021-09-29, ESCOMP/CISM-wrapper#60) in testlist_cism.xml for details of the two tests that I feel should still be added.

billsacks commented 2 years ago

Actually, I'm temporarily removing one other nuopc test that currently isn't working: ERS_D_Ly3.f09_g17_gris4.T1850Gg.cheyenne_intel.cism-noevolve. If I remember correctly, @mvertens has fixed this on a branch of CMEPS, so we should be able to add this test at some point. I have gone back and forth on whether it's worth having this test, but I currently think it could be helpful: even though a T compset noevolve configuration would be a weird thing to run for a production case, it's a convenient way to make sure that exact restart works for CISM in noevolve mode. The alternative would be to test this (i.e., restarting in noevolve mode) via an I compset, but running a multi-year I compset test takes significantly more time to turn around.

See 1d2d81b8. We can back out that commit once this is working.

ESCOMP / CISM-wrapper

Once nuopc/cmeps cases work on izumi, add some testing #60