[develop] Gnu/13.x compiler and spack-stack 1.5.1 use on Hera

natalie-perlin commented 4 months ago

DESCRIPTION OF CHANGES:

Use updated compiler gnu/13.3.0 with openmpi/4.1.6 on Hera. Spack-stack-1.5.1 with the packages for the UFS-WM and UFS-SRW is built with this compiler-mpi combination. Fundamental tests pass on Hera successfully

A modulefile modulefiles/build_hera_gnu.lua has been updated for this PR.

Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

TESTS CONDUCTED:

Fundamental tests pass successfully on Hera.

All 6 experiments finished
Calculating core-hour usage and printing final summary
----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta_2  COMPLETE              13.63
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2_20240  COMPLETE               9.81
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v17_p8_plot  COMPLETE              20.74
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_HRRR_suite_HRRR_2024052  COMPLETE              49.59
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_RAP_suite_WoFS_v0_20240529032  COMPLETE              34.25
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_GFS_v16_2024052903210  COMPLETE              38.91
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             166.93

WE2E_summary_20240529040939.txt WE2E_tests_20240529032105.yaml.txt

Detailed summary written to /scratch1/NCEPDEV/stmp2/Natalie.Perlin/expt_dirs/WE2E_summary_20240529040939.txt

[x] hera.gnu
[ ] hera.intel
[ ] orion.intel
[ ] hercules.intel
[ ] cheyenne.intel
[ ] cheyenne.gnu
[ ] derecho.intel
[ ] gaea.intel
[ ] gaeac5.intel
[ ] jet.intel
[ ] wcoss2.intel
[ ] NOAA Cloud (indicate which platform)
[ ] Jenkins
[x] fundamental test suite
[ ] comprehensive tests (specify which if a subset was used)

DEPENDENCIES:

DOCUMENTATION:

ISSUE:

This addresses previous issues with Gnu compilers on Hera. Relevant issues: https://github.com/ufs-community/ufs-weather-model/issues/2263 A compiler bug report: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=115107 https://github.com/JCSDA/spack-stack/issues/1090

CHECKLIST

[x] My code follows the style guidelines in the Contributor's Guide
[x] I have performed a self-review of my own code using the Code Reviewer's Guide
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] My changes need updates to the documentation. I have made corresponding changes to the documentation
[ ] My changes do not require updates to the documentation (explain).
[ ] My changes generate no new warnings
[ ] New and existing tests pass with my changes
[ ] Any dependent changes have been merged and published

LABELS (optional):

A Code Manager needs to add the following labels to this PR:

[ ] Work In Progress
[ ] bug
[x] enhancement
[ ] documentation
[ ] release
[ ] high priority
[ ] run_ci
[ ] run_we2e_fundamental_tests
[ ] run_we2e_comprehensive_tests
[ ] Needs Cheyenne test
[ ] Needs Jet test
[ ] Needs Hera test
[ ] Needs Orion test
[ ] help wanted

CONTRIBUTORS (optional):

natalie-perlin commented 4 months ago

Some updates for the weather model: Hera GNU RT tests with spack-stack-1.6.0 have passes successfully. A different location of the spack-stack-1.6.0 has been used (from the current PR), which had the versions of the packages as in other systems' spack-stack-1.6.0.

https://github.com/ufs-community/ufs-weather-model/pull/2093#issuecomment-2143694396

It is possible that if the UFS-WM moves to spack-stack/1.6.0 that contains gnu/13.3.0 for Hera, the SRW could also be updated to spack-stack/1.6.0 for Hera + gnu/13.3.0 as well, without the intermediate PR to use spack-stack-1.5.1 step.

MichaelLueken commented 4 months ago

@natalie-perlin -

Since it looks like the weather model will be moving straight from spack-stack 1.5.1 to 1.6.0 (with no intermediate PR to use GNU/13.3 with spack-stack 1.5.1 on Hera), it would probably be best to update this to spack-stack 1.6.0 with GNU/13.3. on Hera. Once the weather model merges PR #2093, then the DO_NOT_MERGE label would be removed.

natalie-perlin commented 4 months ago

ufs-weather-model spack-stack has been moved to spack-stack-1.6.0, which includes Hera gnu 13.3.0 compiler with spack-stack/1.6.0 as well https://github.com/ufs-community/ufs-weather-model/pull/2093 (MERGED)

ufs-community / ufs-srweather-app