NOAA-EMC / GSI

Gridpoint Statistical Interpolation
GNU Lesser General Public License v3.0
66 stars 150 forks source link

spack-stack Intel will use MKL for FFTW/BLAS/LAPACK functionality #780

Open AlexanderRichert-NOAA opened 2 months ago

AlexanderRichert-NOAA commented 2 months ago

The current plan for the next release of spack-stack (1.8.0) to use Intel MKL for FFTW/BLAS/LAPACK functionality instead of the FFTW and OpenBLAS libraries for all of the Intel-based stacks.

See https://github.com/JCSDA/spack-stack/pull/1226, including for test installations

RussTreadon-NOAA commented 2 months ago

FYI: @CatherineThomas-NOAA , @ShunLiu-NOAA , @ManuelPondeca-NOAA, @DavidHuber-NOAA - not sure if this change will impact global or regional gsi.x wall times.

RussTreadon-NOAA commented 2 months ago

@CatherineThomas-NOAA , @ShunLiu-NOAA , @ManuelPondeca-NOAA , or @DavidHuber-NOAA : do any of you have comments on this issue?

@AlexanderRichert-NOAA , what is the status of spack-stack/1.8.0?

DavidHuber-NOAA commented 2 months ago

I will be working on upgrading the GSI to SS/1.8.0 over the next couple of weeks, so this will be tested. However, if I recall correctly, openblas is still being used on some sites (Hera and Jet at least and maybe Orion, Jet, and Gaea as well). It would be good to get confirmation of that from @AlexanderRichert-NOAA.

RussTreadon-NOAA commented 2 months ago

Thank you @DavidHuber-NOAA for the update. spack-stack/1.8.0 touches a few GSI issues - this issue, #642, and possibly more.

AlexanderRichert-NOAA commented 2 months ago

@RussTreadon-NOAA we're in the process of deploying 1.8.0 right now. I think OpenBLAS/FFTW stayed in place on a number of systems. @climbfuji as far as GSI-relevant platforms, I don't see the "override" that restores using OpenBLAS/FFTW in the Jet config or either of the Discover configs, but I do for Hera, Orion/Hercules, Gaea, and S4. Does that sound correct?

climbfuji commented 2 months ago

Discover is ok (not a GSI relevant platform), Jet must be an oversight on my end!