aerorahul commented 3 days ago

Description

This PR:

updates a few submodules (GSI, GSI-utils, GSI-monitor, UFS_utils, GFS-utils) to include recent update to their modulefiles for Orion+Rocky9 upgrade
updates the modulefiles in global-workflow to load modules from Orion+Rocky9 paths
updates modulefiles for gwsetup and gwci as well. (We need to find a better way that spreading this information in 3 different modulefiles)
removes NCL and GEMPAK from Orion. NCL is not used and GEMPAK is not installed.
adds parm/config.gfs/config.resources.ORION to address GSI performance degradation after Rocky 9 upgrade.

This PR:

does not update the ufs-weather-model (it is handled in PR #2729
does not update the build for UPP. Standalone UPP is not available via ufs-weather-model as of #2729
will need a follow-up update for prepobs and fit2obs updated locations when they are installed in glopara space on Orion.

Type of change

Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

Is this a breaking change (a change in existing functionality)? NO
Does this change require a documentation update? NO

How has this been tested?

This PR is not sufficient for Orion. This PR must be tested on other platforms (Hera, WCOSS2) as this PR updates submodules.

Checklist

[ ] Any dependent changes have been merged and published
[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] My changes generate no new warnings
[ ] New and existing tests pass with my changes
[ ] I have made corresponding changes to the documentation if necessary

aerorahul commented 3 days ago

The walltimes for the *anal and eupd jobs likely need to be increased, at least temporarily, for Orion given that the GSI is running far less than optimally on the system. Based on @RussTreadon-NOAA's findings, I'd suggest doubling the requested walltimes for gdas/gfsanal to 2:40 and 2:00, respectively. The eupd job typically runs in much less than 30 minutes on most systems, so it may be fine and could be revisited later if need be.

Thanks for reminding me of this issue. I have added a config.resources.ORION increasing the walltime for gfs|gdas analysis task, doubling the walltime with a block comment on the need.

emcbot commented 3 days ago


CI Update on Wcoss2 at 07/01/24 05:12:08 PM
============================================
Cloning and Building global-workflow PR: 2741
with PID: 37144 on host: dlogin08

aerorahul commented 3 days ago

Ah, I see now you will want to update module_gwsetup.orion.ua and module_gwci.orion.lua to point to the new spack-stack.

Thanks @DavidHuber-NOAA updates to these modulefiles have been applied.

emcbot commented 3 days ago

Automated global-workflow Testing Results:


Machine: Wcoss2
Start: Mon Jul  1 17:14:58 UTC 2024 on dlogin08
---------------------------------------------------
Build: Completed at 07/01/24 05:51:20 PM
Case setup: Completed for experiment C48_ATM_e87db13e
Case setup: Skipped for experiment C48mx500_3DVarAOWCDA_e87db13e
Case setup: Skipped for experiment C48_S2SWA_gefs_e87db13e
Case setup: Completed for experiment C48_S2SW_e87db13e
Case setup: Completed for experiment C96_atm3DVar_extended_e87db13e
Case setup: Skipped for experiment C96_atm3DVar_e87db13e
Case setup: Completed for experiment C96_atmaerosnowDA_e87db13e
Case setup: Completed for experiment C96C48_hybatmDA_e87db13e
Case setup: Completed for experiment C96C48_ufs_hybatmDA_e87db13e

aerorahul commented 3 days ago

Looks good (again).

One additional note: since the UPP cannot be built as is, users will get an error from build_all.sh that they should be instructed to ignore. Alternatively, we could temporarily disable that build on Orion within build_upp.sh (with a printed note). In any case, the *anlupp jobs will be unable to run, preventing cycling.

Thanks @DavidHuber-NOAA This PR is not sufficient for Orion to be up and usable again. @WenMeng-NOAA is aware.

emcbot commented 3 days ago

All CI Test Cases Passed on Wcoss2:


Experiment C48_ATM_e87db13e *** SUCCESS *** at 07/01/24 07:08:12 PM
Experiment C48_S2SW_e87db13e *** SUCCESS *** at 07/01/24 07:16:11 PM
Experiment C96C48_hybatmDA_e87db13e *** SUCCESS *** at 07/01/24 08:32:37 PM
Experiment C96_atmaerosnowDA_e87db13e *** SUCCESS *** at 07/01/24 09:08:29 PM
Experiment C96C48_ufs_hybatmDA_e87db13e *** SUCCESS *** at 07/01/24 09:56:25 PM
Experiment C96_atm3DVar_extended_e87db13e *** SUCCESS *** at 07/02/24 04:36:35 AM