NOAA-EMC / hpc-stack

Create a software stack for HPC's
GNU Lesser General Public License v2.1
30 stars 36 forks source link

Missing hpc-stack on Orion after the last maintenance cycle #529

Open wzzheng90 opened 8 months ago

wzzheng90 commented 8 months ago

The UFS compilation is pointing to an hpc-stack location that no longer exists on Orion: /work/noaa/epic-ps/role-epic-ps/hpc-stack/libs/intel-2022.1.2/modulefiles/stack.

/work/noaa/epic-ps doesn't exist

The Orion Help Desk mentioned that "/work/noaa/epic-ps/" was removed in early November. Could you please look at it and any other solution to resolve this issue?

Thanks,

Weizhong

Hang-Lei-NOAA commented 8 months ago

Please EPIC check the installations on Orion, thanks @Jong Kim

On Mon, Jan 29, 2024 at 6:53 PM Weizhong Zheng @.***> wrote:

Assigned #529 https://github.com/NOAA-EMC/hpc-stack/issues/529 to @Hang-Lei-NOAA https://github.com/Hang-Lei-NOAA.

— Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/529#event-11634643338, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFADDTRQM5PIPNGGPX3YRAZAVAVCNFSM6AAAAABCQJVOPOVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJRGYZTINRUGMZTGOA . You are receiving this because you were assigned.Message ID: @.***>

DavidHuber-NOAA commented 8 months ago

FYI @jkbk2004

There is another installation of hpc-stack here: /work/noaa/epic/role-epic/contrib/hpc-stack/intel-oneapi-2022.2.1. I have not tried using it (at least recently), but that may be a solution.

wzzheng90 commented 8 months ago

@DavidHuber-NOAA Thank you very much for your suggestion!

I use the hpc-stack you suggested "/work/noaa/epic/role-epic/contrib/hpc-stack/intel-oneapi-2022.2.1/modulefiles/stack" to replace "/work/noaa/epic/role-epic/contrib/hpc-stack/intel-oneapi-2022.2.1/modulefiles/stack") in ufs_orion.intel.lua.

The error messages show more modules requested: "esmf/8.3.0b09", "mapl/2.22.0-esmf-8.3.0b09", "jasper/2.0.25".
I do not find these modules are available after I type "module avail". Anything I need to correct?

Weizhong

DavidHuber-NOAA commented 8 months ago

@wzzheng90 I'm not the best person to answer these questions. If you can consider upgrading to a newer model version that supports spack-stack, that will get you better support. Jong (already tagged) may also be able to make a suggestion.

wzzheng90 commented 8 months ago

@DavidHuber-NOAA Thanks again for your suggestion. Yes, the new model version (e.g., HR3) does have this kind of problem. However, I still needs to run the previous versions (e.g., HR2) for comparison purposes. I am not clear about how to migrate to spack-stack in the previous versions.

ulmononian commented 8 months ago

@wzzheng90 what version of the ufs-wm are you using? i saw @DavidHuber-NOAA asked, but you might consider using one of the spack-stacks on orion? they are located in /work/noaa/epic/role-epic/spack-stack/orion and documentation is available here: https://spack-stack.readthedocs.io/en/latest/PreConfiguredSites.html#msu-orion.

@natalie-perlin can you suggest the hpc-stack equivalent for the one in the old role-epic-ps space described in this issue, i.e.: /work/noaa/epic-ps/role-epic-ps/hpc-stack/libs/intel-2022.1.2/modulefiles/stack (if there is one)?

wzzheng90 commented 8 months ago

@ulmononian The version of the ufs-wm I used is "63a43d9" (updated on Oct 26, 2023). I am not clear which one of the spack-stacks on orion can replace the old role-epic-ps. That will be great if @natalie-perlin can give a help. Thanks!

ulmononian commented 8 months ago

@wzzheng90 looking at commit hash 63a43d9, the orion intel modulefile seems to already point to spack-stack version 1.4.1 (/work/noaa/epic/role-epic/spack-stack/spack-stack-1.4.1/envs/ufs-pio-2.5.10/install/modulefiles/Core). are you using your own modulefile and just checking-out/building the wm as a part of a different application/workflow?

wzzheng90 commented 8 months ago

@ulmononian Sorry, my mistake! 63a43d9 is for HR3. I used HR2 and the version of the ufs-wm is "4d05445" (updated on Jul 24, 2023). In "ufs_orion.intel.lua", it uses "/work/noaa/epic-ps/role-epic-ps/hpc-stack/libs/intel-2022.1.2/modulefiles/stack")