Failing ne0CONUSne30x8_ne0CONUSne30x8_mt12 in CESM testing

ekluzek commented 4 months ago

Brief summary of bug

@fischer-ncar found the following test to be failing in cesm2_3_alpha17f testing:

PEND SMS_D_Ln9_P1280x1.ne0CONUSne30x8_ne0CONUSne30x8_mt12.FCnudged.derecho_intel.cam-outfrq9s SHAREDLIB_BUILD

General bug information

CTSM version you are using: ctsm5.2.005

Does this bug cause significantly incorrect results in the model's science? No Configurations affected: CONUS VR grid for FCnudged compset

Details of bug

Important output or errors that show the problem

err=ERROR : CLM build-namelist::CLMBuildNamelist::setup_logic_initial_conditions() : use_init_interp is NOT synchronized with init_interp_attributes in the namelist_defaults file, this should be corrected there'

Definition of done:

[ ] Test SMS_Ln9.ne0CONUSne30x8_ne0CONUSne30x8_mt12.IHistClm50Sp.derecho_intel.clm-clm50cam6LndTuningMode_2013Start to show it fails
[ ] Change CONUS test in build-namelist test to do a transient use-case
[ ] Make sure the namelist testing is doing transient tests with the correct start dates for the datasets we have for 1979-PD.
[ ] Run build-namelist tests to show those new tests fail
[ ] Fix use_init_interp for CLM50 so it works
[ ] Show that build-namelist tests now pass
[ ] Test SMS_Ln9.ne0CONUSne30x8_ne0CONUSne30x8_mt12.IHistClm50Sp.derecho_intel.clm-clm50cam6LndTuningMode_2013Start to show it now works

ekluzek commented 4 months ago

We talked about this in CSEG and decided since this is only for a less used VR grid (and there is a namelist fix for it) that we would do this after the remove externals beta tag. @cacraigucar @adamrher

The namelist fix is to just add the following to user_nl_clm:

use_init_interp = .true.

I have NOT explicitly tested the above, but do believe it will work. If someone actually tries this -- let us know if it works.

adamrher commented 4 months ago

We talked about this in CSEG and decided since this is only for a less used VR grid (and there is a namelist fix for it) that we would do this after the remove externals beta tag. @cacraigucar @adamrher

Fine by me. But for the record, this is probably the most used VR grid. But lately we have been more focused on the 1deg workhorse and so we haven't really been running the VR grids.

ekluzek commented 4 months ago

This is the same problem as #2520 and again is a result of the fragility issues identified in #2169.

FCnudged is a HIST compset currently with CLM50%SP that starts in 2013. The following test was run and PASSED in ctsm5.2.005 and looks to me like it's almost identical (other than using CLM60 rather than CLM50).

SMS_Ln9.ne0CONUSne30x8_ne0CONUSne30x8_mt12.IHistClm60Sp.derecho_intel.clm-clm60cam6LndTuningMode_2013Start

The build-namelist testing does NOT cover it because it's not doing a transient case for is only 1850 and 2000 control. So we should add a transient test in the namelist testing as well.

ESCOMP / CTSM