CH-Earth / summa

Structure for Unifying Multiple Modeling Alternatives:
http://www.ral.ucar.edu/projects/summa
GNU General Public License v3.0
80 stars 104 forks source link

Fatal error with updateVars residual #440

Open lou-a opened 3 years ago

lou-a commented 3 years ago

I recently came across this error message when running SUMMA simulations on Cheyenne at NCAR:

1986 5 2 0 0 1986 5 3 0 0 1986 5 4 0 0 1986 5 5 0 0 1986 5 6 0 0 1986 5 7 0 0 1986 5 8 0 0 1986 5 9 0 0 1986 5 10 0 0 1986 5 11 0 0

ERROR: residual is not valid in xTempSolve heatCap 1282183.5874411333
xTemp 273.13292935447299
tempInit 273.13292935447299
meltNrg 306002900.00000000
volFracIceTrial NaN volFracIceInit 0.41306074636570100
dLiq_dT NaN

FATAL ERROR: run_oneGRU/run_oneHRU/coupled_em/opSplittin/varSubstep/updateProg/updateVars/residual is not valid

This error happens for a handful of GRUs-years.

Andy Wood found a temporary fix: “One thing to try is loosening the tolerances in localParamInfo.txt by 1 exponent, eg 1e-3 becomes 1e-2. They’ll be all the ~6 variables with ‘Tol’ in the name ... toward the bottom.”