ESMCI / ccs_config_cesm

CESM CIME Case Control System configuration files
3 stars 46 forks source link

Drop nvhpc to 23.7 on derecho? #187

Closed mnlevy1981 closed 1 month ago

mnlevy1981 commented 2 months ago

MOM6 has some stand-alone tests that run fine on derecho when built with nvhpc 24.3 until we turn MARBL on -- with the MARBL tracers enabled, the runs abort with a very unphysical state. Building the model with 23.7 instead of 24.3 lets those tests with the MARBL tracers run successfully. I haven't tested this, but I suspect there will be issues running MARBL in the global CESM if it is built with 24.3, so I was hoping we could drop back to an older compiler version until someone (probably me) has a chance to track down what is causing the issue with the newer compiler.

jedwards4b commented 1 month ago

Not going backward - since nvhpc is not the default compiler I think that we should just note this as a known failure and report to nvidia.

mnlevy1981 commented 1 month ago

Fair enough -- once beta04 is ready, I'll do some testing with nvhpc and try to come up with a useful report for nvidia. Thanks!

sjsprecious commented 1 month ago

@mnlevy1981 the latest nvidia compiler version on Derecho is nvhpc/24.9, does it work for your MARBL build?

jedwards4b commented 1 month ago

I'll be working on an update of compilers on derecho next week.