geoschem / GCHP

The "superproject" wrapper repository for GCHP, the high-performance instance of the GEOS-Chem chemical-transport model.
https://gchp.readthedocs.io
Other
21 stars 25 forks source link

GCHP dies without an error message when encountering missing species in the restart file (or if restart file does not exist) #352

Closed yantosca closed 3 months ago

yantosca commented 10 months ago

Name and Institution (Required)

Name: Bob Yantosca Institution: Harvard + GCST

Confirm you have reviewed the following documentation

New GCHP feature or discussion

Using the Require_Species_in_Restart=1 setting in the setCommonRunSettings.sh script) will cause GCHP simulations to terminate without a corresponding error message (either in the gchp*log file or in allPEs.log). This can give the user a false idea as to what the failure was caused by.

yantosca commented 10 months ago

I have also confirmed that no error message is given if the restart is not present in the run directory. GCHP will proceed to try to initialize Dynamics (and that is the last thing that gets written to allPEs.log.

lizziel commented 10 months ago

The fixes for these issues will need to go into MAPL. Restarts are handled within the MAPL Generic component based on the restart attribute attached to each internal state variable. When we set Require_Species_in_Restart=1 in setCommonRunSettings.sh the restart attribute is set to required in GCHP subroutine SetServices.

yantosca commented 10 months ago

@lizziel: I can open a corresponding PR on the MAPL repo.

lizziel commented 10 months ago

Thank you!

lizziel commented 8 months ago

I am running into this issue while testing RRTMG. I'll check on if we can do anything about it.

lizziel commented 3 months ago

I have discussed this with GMAO developers and we now anticipate a fix in MAPL3 which will be part of GCHP 15.0.