NOAA-EMC / GDASApp

Global Data Assimilation System Application
GNU Lesser General Public License v2.1
15 stars 31 forks source link

Update GDASApp to spack-stack/1.9.0 #1283

Open RussTreadon-NOAA opened 2 months ago

RussTreadon-NOAA commented 2 months ago

EIB informed the DA group that spack-stack/1.8 spack-stack/1.9.0 will be released soon. GDASApp modulefiles currently use spack-stack/1.6. This issue is opened to document the updating of GDASApp modulefiles to spack-stack/1.8 spack-stack/1.9.0.

RussTreadon-NOAA commented 1 month ago

@DavidHuber-NOAA , do you know if we have spack-stack (any version) installed on Acorn?

We use spack-stack to build GDASApp on NOAA RDHPCS. It would be nice to use spack-stack for the WCOSS2 GDASApp build. I don't think spack-stack can be installed on Cactus or Dogwood yet (can it?). spack-stack may, however, already be on Acorn. Is this the case? If so, where can I find spack-stack on Acorn?

DavidHuber-NOAA commented 1 month ago

@RussTreadon-NOAA Yes, spack-stack 1.4.0-1.8.0 are available on Acorn. The installations are under /lfs/h1/emc/nceplibs/noscrub/spack-stack/spack-stack-<version>/envs/<environment name>/install/modulefiles/Core.

As for Cactus and Dogwood, it looks like those systems will have spack-stack installed and supported fairly soon. I will be meeting with Steven, Hang, Alex, et al. this week to go over details, so stay tuned.

RussTreadon-NOAA commented 1 month ago

Thank you @DavidHuber-NOAA . This is great news. Let me try to build GDASApp on Acorn using spack-stack. If this works, we're ready when spack-stack is available on WCOSS2.

RussTreadon-NOAA commented 1 month ago

FYI @DavidHuber-NOAA , I was able to create an acorn.intel.lua using spack-stack/1.6.0 to build GDASApp on Acorn. I chose spack-stack/1.6.0 because this is what we use on NOAA RHDPCS machines. acorn.intel.lua was committed to GDASApp branch feature/build at f3fe406. I'll run some tests on Acorn once the queues are opened to developers.

Hopefully updating to spack-stack/1.8.0 is relatively straight forward. It would be great to see spack-stack on WCOSS2 sometime this fall.

RussTreadon-NOAA commented 1 week ago

The full installation of spack-stack/1.8.0 may be delayed until January 2025 or later. Is this correct @DavidHuber-NOAA?

DavidHuber-NOAA commented 1 week ago

@RussTreadon-NOAA I seem to have misinterpreted a message in one of the UFS issues. It looks like they may be targeting this quarter, not next.

To summaries, the installation is available, but the weather model is having issues with the MAPL/ESMF versions in spack-stack 1.8.0. There is a test installation available of a newer MAPL library that appears to work. These are the issues that I suggest tracking: https://github.com/ufs-community/ufs-weather-model/issues/2345 and https://github.com/ufs-community/ufs-weather-model/issues/2346.

RussTreadon-NOAA commented 1 week ago

Thank you @DavidHuber-NOAA for the update. Looks like we can try GDASApp with spack-stack/1.8.0 on at least some machines.

RussTreadon-NOAA commented 1 day ago

Learned from GSI PR #791 that spack-stack developers recommend waiting for spack-stack/1.9.0.

RussTreadon-NOAA commented 1 day ago

Rename this issue to reference the new spack-stack target.