PawseySC / pawsey-spack-config

Automated deployment system for the scientific software stack in use at Pawsey
BSD 3-Clause "New" or "Revised" License
4 stars 9 forks source link

Missing cmake module in Cray environment during the software stack deployment #228

Open ddeeptimahanti opened 1 year ago

ddeeptimahanti commented 1 year ago

For some reason, cmake module wasn't available after the deployment in the Cray environment. Only hidden module is available:

ddeeptimahanti@setonix-02:~> module --show_hidden av cmake

cmake/3.24.3-enoxs2u

----------------------- /software/setonix/2023.08/modules/zen3/cce/15.0.1/dependencies ----------------------- .cmake/3.24.3-e5hipii (H)

ddeeptimahanti commented 1 year ago

Installing it now:

module load spack/0.19.0 spack install -j128 cmake@3.24.3 %cce@15.0.1

ddeeptimahanti commented 1 year ago
`==> Concretized cmake@3.24.3%cce@15.0.1 arch=None-None-zen2
 -   cki7xvt  cmake@3.24.3%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~doc+ncurses+ownlibs~qt build_system=generic build_type=Release arch=linux-sles15-zen2
[+]  oseny4z      ^ncurses@6.3%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" ~symlinks+termlib abi=none build_system=autotools arch=linux-sles15-zen2
[+]  2hcq37q          ^pkg-config@0.29.2%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +internal_glib build_system=autotools arch=linux-sles15-zen2
 -   3zhjm54      ^openssl@1.1.1%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" ~docs~shared build_system=generic certs=mozilla arch=linux-sles15-zen2

==> Concretized cmake@3.24.3%cce@15.0.1 arch=None-None-zen3
 -   e5hipii  cmake@3.24.3%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~doc+ncurses~ownlibs~qt build_system=generic build_type=Release arch=linux-sles15-zen3
 -   usgpmot      ^curl@7.79.1%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~gssapi~ldap~libidn2~librtmp~libssh~libssh2~nghttp2 build_system=autotools libs=shared,static tls=openssl arch=linux-sles15-zen3
[+]  kbl32le      ^expat@2.4.8%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +libbsd build_system=autotools arch=linux-sles15-zen3
[+]  haqmz4x          ^libbsd@0.11.5%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=autotools arch=linux-sles15-zen3
[+]  3m462et              ^libmd@1.0.4%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=autotools arch=linux-sles15-zen3
 -   o4dal4d      ^libarchive@3.5.2%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +iconv build_system=autotools compression=bz2lib,lz4,lzma,lzo2,zlib,zstd crypto=mbedtls libs=shared,static programs=none xar=expat arch=linux-sles15-zen3
[+]  a3u5xsx          ^bzip2@1.0.8%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" ~debug~pic+shared build_system=generic arch=linux-sles15-zen3
[+]  p7vz276              ^diffutils@3.8%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=autotools arch=linux-sles15-zen3
[+]  xgkdevp          ^libiconv@1.16%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=autotools libs=shared,static arch=linux-sles15-zen3
 -   lvdwj6s          ^lz4@1.9.4%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=makefile libs=shared,static arch=linux-sles15-zen3
 -   p3ks5ut          ^lzo@2.10%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch"  build_system=autotools libs=shared,static arch=linux-sles15-zen3
 -   ge6emai          ^mbedtls@2.28.0%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +pic build_system=makefile build_type=Release libs=static arch=linux-sles15-zen3
[+]  yvt4er3          ^xz@5.2.7%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" ~pic build_system=autotools libs=shared,static arch=linux-sles15-zen3
[+]  2xiug4h          ^zstd@1.5.0%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +programs build_system=makefile compression=none libs=shared,static arch=linux-sles15-zen3
 -   lo3ma2p      ^libuv@1.44.1%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools arch=linux-sles15-zen3
[+]  fmtnawi      ^ncurses@6.3%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" ~symlinks+termlib abi=none build_system=autotools arch=linux-sles15-zen3
[+]  ru66hcc          ^pkg-config@0.29.2%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +internal_glib build_system=autotools arch=linux-sles15-zen3
 -   77l6g6z      ^rhash@1.4.2%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=makefile patches=093518c,3fbfe46 arch=linux-sles15-zen3
[+]  2icbpr5      ^zlib@1.2.13%gcc@12.2.0 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3 -fallow-argument-mismatch" +optimize+pic+shared build_system=makefile arch=linux-sles15-zen3`

Cmake in Cray env is picking up gcc packages
ddeeptimahanti commented 1 year ago

I installed it again and the spec looks good but the modulefile is still hidden.

spack@setonix-02:~$ module load spack/0.19.0 
Note: when this module is unloaded, the shell environment will NOT revert to its original state, and retain some
Spack settings. If you need the original shell environment, start a new shell session instead. 
spack@setonix-02:~$ spack spec -Il cmake@3.24.3 %cce@15.0.1
Input spec
--------------------------------
 -   cmake@3.24.3%cce@15.0.1

Concretized
--------------------------------
[+]  p6jl2y6  cmake@3.24.3%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~doc+ncurses~ownlibs~qt build_system=generic build_type=Release arch=linux-sles15-zen3
[+]  usgpmot      ^curl@7.79.1%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~gssapi~ldap~libidn2~librtmp~libssh~libssh2~nghttp2 build_system=autotools libs=shared,static tls=openssl arch=linux-sles15-zen3
[+]  wsgftsl      ^expat@2.4.8%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" +libbsd build_system=autotools arch=linux-sles15-zen3
[+]  wc4rpfn          ^libbsd@0.11.5%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools arch=linux-sles15-zen3
[+]  jv432ky              ^libmd@1.0.4%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools arch=linux-sles15-zen3
[+]  qzlybnh      ^libarchive@3.5.2%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" +iconv build_system=autotools compression=bz2lib,lz4,lzma,lzo2,zlib crypto=mbedtls libs=shared,static programs=none xar=expat arch=linux-sles15-zen3
[+]  mwqpv7r          ^bzip2@1.0.8%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~debug~pic+shared build_system=generic arch=linux-sles15-zen3
[+]  dqhn3bm              ^diffutils@3.8%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools arch=linux-sles15-zen3
[+]  zwno2qy          ^libiconv@1.16%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools libs=shared,static arch=linux-sles15-zen3
[+]  uiuem4z          ^lz4@1.9.4%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=makefile libs=shared,static arch=linux-sles15-zen3
[+]  xjph37b          ^lzo@2.10%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools libs=shared,static arch=linux-sles15-zen3
[+]  lyvwd37          ^mbedtls@2.28.0%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" +pic build_system=makefile build_type=Release libs=static arch=linux-sles15-zen3
[+]  qdfx6pg          ^xz@5.2.7%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~pic build_system=autotools libs=shared,static arch=linux-sles15-zen3
[+]  lo3ma2p      ^libuv@1.44.1%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=autotools arch=linux-sles15-zen3
[+]  dontu6q      ^ncurses@6.3%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" ~symlinks+termlib abi=none build_system=autotools arch=linux-sles15-zen3
[+]  kdu2tar          ^pkg-config@0.29.2%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" +internal_glib build_system=autotools arch=linux-sles15-zen3
[+]  77l6g6z      ^rhash@1.4.2%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3"  build_system=makefile patches=093518c,3fbfe46 arch=linux-sles15-zen3
[+]  glsujlu      ^zlib@1.2.13%cce@15.0.1 cflags="-O3" cppflags="-O3" cxxflags="-O3" fflags="-O3" +optimize+pic+shared build_system=makefile arch=linux-sles15-zen3

spack@setonix-02:~$ module swap PrgEnv-gnu/8.3.3 PrgEnv-cray

Lmod is automatically replacing "gcc/12.2.0" with "cce/15.0.1".

Due to MODULEPATH changes, the following have been reloaded:
  1) cray-mpich/8.1.25     2) python/3.10.10

spack@setonix-02:~$ module av cmake
No module(s) or extension(s) found!
If the avail list is too long consider trying:

"module --default avail" or "ml -d av" to just list the default modules.
"module overview" or "ml ov" to display the number of modules for each name.

Use "module spider" to find all possible modules and extensions.
Use "module keyword key1 key2 ..." to search for all possible modules matching any of the "keys".

spack@setonix-02:~$ module --show_hidden av cmake

------------------------ /software/setonix/2023.08/modules/zen3/cce/15.0.1/dependencies -------------------------
   .cmake/3.24.3-e5hipii (H)    .cmake/3.24.3-p6jl2y6 (H)

  Where:
   H:  Hidden Module

If the avail list is too long consider trying:

"module --default avail" or "ml -d av" to just list the default modules.
"module overview" or "ml ov" to display the number of modules for each name.

Use "module spider" to find all possible modules and extensions.
Use "module keyword key1 key2 ..." to search for all possible modules matching any of the "keys".