search

EESSI / software-layer

Software layer of the EESSI project
https://eessi.github.io/docs/software_layer
GNU General Public License v2.0
20 stars 43 forks source link

{2023.06,zen4} add missing installations with foss/2023b #614

Closed boegel closed 2 weeks ago

boegel commented 2 weeks ago

This should add all software we currently have installed for the other CPU targets to x86_64/amd/zen4.

This includes a couple of "expensive" builds like X11 and Qt5, so we may need to split this up in smaller chunks, we'll see...

86 out of 146 required modules missing:
``` * giflib/5.2.1-GCCcore-13.2.0 (giflib-5.2.1-GCCcore-13.2.0.eb) * libpng/1.6.40-GCCcore-13.2.0 (libpng-1.6.40-GCCcore-13.2.0.eb) * Bison/3.8.2-GCCcore-13.2.0 (Bison-3.8.2-GCCcore-13.2.0.eb) * NASM/2.16.01-GCCcore-13.2.0 (NASM-2.16.01-GCCcore-13.2.0.eb) * libiconv/1.17-GCCcore-13.2.0 (libiconv-1.17-GCCcore-13.2.0.eb) * Szip/2.1.1-GCCcore-13.2.0 (Szip-2.1.1-GCCcore-13.2.0.eb) * ecBuild/3.8.0 (ecBuild-3.8.0.eb) * jbigkit/2.1-GCCcore-13.2.0 (jbigkit-2.1-GCCcore-13.2.0.eb) * PCRE/8.45-GCCcore-13.2.0 (PCRE-8.45-GCCcore-13.2.0.eb) * cppy/1.2.1-GCCcore-13.2.0 (cppy-1.2.1-GCCcore-13.2.0.eb) * CFITSIO/4.3.1-GCCcore-13.2.0 (CFITSIO-4.3.1-GCCcore-13.2.0.eb) * re2c/3.1-GCCcore-13.2.0 (re2c-3.1-GCCcore-13.2.0.eb) * tqdm/4.66.2-GCCcore-13.2.0 (tqdm-4.66.2-GCCcore-13.2.0.eb) * libjpeg-turbo/3.0.1-GCCcore-13.2.0 (libjpeg-turbo-3.0.1-GCCcore-13.2.0.eb) * Doxygen/1.9.8-GCCcore-13.2.0 (Doxygen-1.9.8-GCCcore-13.2.0.eb) * libspatialindex/1.9.3-GCCcore-13.2.0 (libspatialindex-1.9.3-GCCcore-13.2.0.eb) * LittleCMS/2.15-GCCcore-13.2.0 (LittleCMS-2.15-GCCcore-13.2.0.eb) * GSL/2.7-GCC-13.2.0 (GSL-2.7-GCC-13.2.0.eb) * double-conversion/3.3.0-GCCcore-13.2.0 (double-conversion-3.3.0-GCCcore-13.2.0.eb) * ICU/74.1-GCCcore-13.2.0 (ICU-74.1-GCCcore-13.2.0.eb) * JasPer/4.0.0-GCCcore-13.2.0 (JasPer-4.0.0-GCCcore-13.2.0.eb) * libdeflate/1.19-GCCcore-13.2.0 (libdeflate-1.19-GCCcore-13.2.0.eb) * libidn2/2.3.2-GCCcore-13.2.0 (libidn2-2.3.2-GCCcore-13.2.0.eb) * Brotli/1.1.0-GCCcore-13.2.0 (Brotli-1.1.0-GCCcore-13.2.0.eb) * gzip/1.13-GCCcore-13.2.0 (gzip-1.13-GCCcore-13.2.0.eb) * Wayland/1.22.0-GCCcore-13.2.0 (Wayland-1.22.0-GCCcore-13.2.0.eb) * wget/1.21.4-GCCcore-13.2.0 (wget-1.21.4-GCCcore-13.2.0.eb) * freetype/2.13.2-GCCcore-13.2.0 (freetype-2.13.2-GCCcore-13.2.0.eb) * libaec/1.0.6-GCCcore-13.2.0 (libaec-1.0.6-GCCcore-13.2.0.eb) * lz4/1.9.4-GCCcore-13.2.0 (lz4-1.9.4-GCCcore-13.2.0.eb) * zstd/1.5.5-GCCcore-13.2.0 (zstd-1.5.5-GCCcore-13.2.0.eb) * Boost/1.83.0-GCC-13.2.0 (Boost-1.83.0-GCC-13.2.0.eb) * Boost.Python/1.83.0-GCC-13.2.0 (Boost.Python-1.83.0-GCC-13.2.0.eb) * LibTIFF/4.6.0-GCCcore-13.2.0 (LibTIFF-4.6.0-GCCcore-13.2.0.eb) * OpenJPEG/2.5.0-GCCcore-13.2.0 (OpenJPEG-2.5.0-GCCcore-13.2.0.eb) * libwebp/1.3.2-GCCcore-13.2.0 (libwebp-1.3.2-GCCcore-13.2.0.eb) * Pillow/10.2.0-GCCcore-13.2.0 (Pillow-10.2.0-GCCcore-13.2.0.eb) * Qhull/2020.2-GCCcore-13.2.0 (Qhull-2020.2-GCCcore-13.2.0.eb) * UDUNITS/2.2.28-GCCcore-13.2.0 (UDUNITS-2.2.28-GCCcore-13.2.0.eb) * PCRE2/10.42-GCCcore-13.2.0 (PCRE2-10.42-GCCcore-13.2.0.eb) * googletest/1.14.0-GCCcore-13.2.0 (googletest-1.14.0-GCCcore-13.2.0.eb) * GLib/2.78.1-GCCcore-13.2.0 (GLib-2.78.1-GCCcore-13.2.0.eb) * nlohmann_json/3.11.3-GCCcore-13.2.0 (nlohmann_json-3.11.3-GCCcore-13.2.0.eb) * Lua/5.4.6-GCCcore-13.2.0 (Lua-5.4.6-GCCcore-13.2.0.eb) * fontconfig/2.14.2-GCCcore-13.2.0 (fontconfig-2.14.2-GCCcore-13.2.0.eb) * PROJ/9.3.1-GCCcore-13.2.0 (PROJ-9.3.1-GCCcore-13.2.0.eb) * X11/20231019-GCCcore-13.2.0 (X11-20231019-GCCcore-13.2.0.eb) * Tk/8.6.13-GCCcore-13.2.0 (Tk-8.6.13-GCCcore-13.2.0.eb) * PGPLOT/5.2.2-GCCcore-13.2.0 (PGPLOT-5.2.2-GCCcore-13.2.0.eb) * Tkinter/3.11.5-GCCcore-13.2.0 (Tkinter-3.11.5-GCCcore-13.2.0.eb) * WCSLIB/7.11-GCC-13.2.0 (WCSLIB-7.11-GCC-13.2.0.eb) * graphite2/1.3.14-GCCcore-13.2.0 (graphite2-1.3.14-GCCcore-13.2.0.eb) * HDF5/1.14.3-gompi-2023b (HDF5-1.14.3-gompi-2023b.eb) * netCDF/4.9.2-gompi-2023b (netCDF-4.9.2-gompi-2023b.eb) * OSU-Micro-Benchmarks/7.2-gompi-2023b (OSU-Micro-Benchmarks-7.2-gompi-2023b.eb) * Valgrind/3.23.0-gompi-2023b (Valgrind-3.23.0-gompi-2023b.eb) * ecCodes/2.31.0-gompi-2023b (ecCodes-2.31.0-gompi-2023b.eb) * IDG/1.2.0-foss-2023b (IDG-1.2.0-foss-2023b.eb) * arpack-ng/3.9.0-foss-2023b (arpack-ng-3.9.0-foss-2023b.eb) * CDO/2.2.2-gompi-2023b (CDO-2.2.2-gompi-2023b.eb) * Armadillo/12.8.0-foss-2023b (Armadillo-12.8.0-foss-2023b.eb) * pixman/0.42.2-GCCcore-13.2.0 (pixman-0.42.2-GCCcore-13.2.0.eb) * cairo/1.18.0-GCCcore-13.2.0 (cairo-1.18.0-GCCcore-13.2.0.eb) * GObject-Introspection/1.78.1-GCCcore-13.2.0 (GObject-Introspection-1.78.1-GCCcore-13.2.0.eb) * HarfBuzz/8.2.2-GCCcore-13.2.0 (HarfBuzz-8.2.2-GCCcore-13.2.0.eb) * scikit-learn/1.4.0-gfbf-2023b (scikit-learn-1.4.0-gfbf-2023b.eb) * matplotlib/3.8.2-gfbf-2023b (matplotlib-3.8.2-gfbf-2023b.eb) * NLTK/3.8.1-foss-2023b (NLTK-3.8.1-foss-2023b.eb) * casacore/3.5.0-foss-2023b (casacore-3.5.0-foss-2023b.eb) * EveryBeam/0.5.2-foss-2023b (EveryBeam-0.5.2-foss-2023b.eb) * AOFlagger/3.4.0-foss-2023b (AOFlagger-3.4.0-foss-2023b.eb) * DP3/6.0-foss-2023b (DP3-6.0-foss-2023b.eb) * WSClean/3.4-foss-2023b (WSClean-3.4-foss-2023b.eb) * python-casacore/3.5.2-foss-2023b (python-casacore-3.5.2-foss-2023b.eb) * snappy/1.1.10-GCCcore-13.2.0 (snappy-1.1.10-GCCcore-13.2.0.eb) * NSPR/4.35-GCCcore-13.2.0 (NSPR-4.35-GCCcore-13.2.0.eb) * Mako/1.2.4-GCCcore-13.2.0 (Mako-1.2.4-GCCcore-13.2.0.eb) * NSS/3.94-GCCcore-13.2.0 (NSS-3.94-GCCcore-13.2.0.eb) * nodejs/20.9.0-GCCcore-13.2.0 (nodejs-20.9.0-GCCcore-13.2.0.eb) * libdrm/2.4.117-GCCcore-13.2.0 (libdrm-2.4.117-GCCcore-13.2.0.eb) * libglvnd/1.7.0-GCCcore-13.2.0 (libglvnd-1.7.0-GCCcore-13.2.0.eb) * libunwind/1.6.2-GCCcore-13.2.0 (libunwind-1.6.2-GCCcore-13.2.0.eb) * LLVM/16.0.6-GCCcore-13.2.0 (LLVM-16.0.6-GCCcore-13.2.0.eb) * Mesa/23.1.9-GCCcore-13.2.0 (Mesa-23.1.9-GCCcore-13.2.0.eb) * libGLU/9.0.3-GCCcore-13.2.0 (libGLU-9.0.3-GCCcore-13.2.0.eb) * Qt5/5.15.13-GCCcore-13.2.0 (Qt5-5.15.13-GCCcore-13.2.0.eb) ```
eessi-bot-aws[bot] commented 2 weeks ago

Instance eessi-bot-mc-aws is configured to build for:

eessi-bot-aws[bot] commented 2 weeks ago

Instance eessi-bot-mc-azure is configured to build for:

boegel commented 2 weeks ago

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

eessi-bot-aws[bot] commented 2 weeks ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4` from `boegel` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` resulted in: - no jobs were submitted
eessi-bot-aws[bot] commented 2 weeks ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4` from `boegel` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` resulted in: - submitted job `115`, for details & status see https://github.com/EESSI/software-layer/pull/614#issuecomment-2169183066
eessi-bot-aws[bot] commented 2 weeks ago
New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_614/115 date job status comment
Jun 15 07:38:08 UTC 2024 submitted job id 115 awaits release by job manager
Jun 15 07:38:22 UTC 2024 released job awaits launch by Slurm scheduler
Jun 15 08:24:23 UTC 2024 running job 115 is running
Jun 15 09:29:50 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-115.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:x: found message matching required modules missing:
:x: no message matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1718443655.tar.gzsize: 135 MiB (142590599 bytes)
entries: 29961
modules under _2023.06/software/linux/x8664/amd/zen4/modules/all
Bison/3.8.2-GCCcore-13.2.0.lua
Boost/1.83.0-GCC-13.2.0.lua
Brotli/1.1.0-GCCcore-13.2.0.lua
CFITSIO/4.3.1-GCCcore-13.2.0.lua
Doxygen/1.9.8-GCCcore-13.2.0.lua
GSL/2.7-GCC-13.2.0.lua
HDF5/1.14.3-gompi-2023b.lua
ICU/74.1-GCCcore-13.2.0.lua
LibTIFF/4.6.0-GCCcore-13.2.0.lua
LittleCMS/2.15-GCCcore-13.2.0.lua
NASM/2.16.01-GCCcore-13.2.0.lua
OpenJPEG/2.5.0-GCCcore-13.2.0.lua
PCRE/8.45-GCCcore-13.2.0.lua
PGPLOT/5.2.2-GCCcore-13.2.0.lua
Pillow/10.2.0-GCCcore-13.2.0.lua
Qhull/2020.2-GCCcore-13.2.0.lua
Szip/2.1.1-GCCcore-13.2.0.lua
Tk/8.6.13-GCCcore-13.2.0.lua
Tkinter/3.11.5-GCCcore-13.2.0.lua
X11/20231019-GCCcore-13.2.0.lua
cppy/1.2.1-GCCcore-13.2.0.lua
fontconfig/2.14.2-GCCcore-13.2.0.lua
freetype/2.13.2-GCCcore-13.2.0.lua
giflib/5.2.1-GCCcore-13.2.0.lua
gzip/1.13-GCCcore-13.2.0.lua
jbigkit/2.1-GCCcore-13.2.0.lua
libdeflate/1.19-GCCcore-13.2.0.lua
libiconv/1.17-GCCcore-13.2.0.lua
libidn2/2.3.2-GCCcore-13.2.0.lua
libjpeg-turbo/3.0.1-GCCcore-13.2.0.lua
libpng/1.6.40-GCCcore-13.2.0.lua
libwebp/1.3.2-GCCcore-13.2.0.lua
lz4/1.9.4-GCCcore-13.2.0.lua
matplotlib/3.8.2-gfbf-2023b.lua
netCDF/4.9.2-gompi-2023b.lua
wget/1.21.4-GCCcore-13.2.0.lua
zstd/1.5.5-GCCcore-13.2.0.lua
software under _2023.06/software/linux/x8664/amd/zen4/software
Bison/3.8.2-GCCcore-13.2.0
Boost/1.83.0-GCC-13.2.0
Brotli/1.1.0-GCCcore-13.2.0
CFITSIO/4.3.1-GCCcore-13.2.0
Doxygen/1.9.8-GCCcore-13.2.0
GSL/2.7-GCC-13.2.0
HDF5/1.14.3-gompi-2023b
ICU/74.1-GCCcore-13.2.0
LibTIFF/4.6.0-GCCcore-13.2.0
LittleCMS/2.15-GCCcore-13.2.0
NASM/2.16.01-GCCcore-13.2.0
OpenJPEG/2.5.0-GCCcore-13.2.0
PCRE/8.45-GCCcore-13.2.0
PGPLOT/5.2.2-GCCcore-13.2.0
Pillow/10.2.0-GCCcore-13.2.0
Qhull/2020.2-GCCcore-13.2.0
Szip/2.1.1-GCCcore-13.2.0
Tk/8.6.13-GCCcore-13.2.0
Tkinter/3.11.5-GCCcore-13.2.0
X11/20231019-GCCcore-13.2.0
cppy/1.2.1-GCCcore-13.2.0
fontconfig/2.14.2-GCCcore-13.2.0
freetype/2.13.2-GCCcore-13.2.0
giflib/5.2.1-GCCcore-13.2.0
gzip/1.13-GCCcore-13.2.0
jbigkit/2.1-GCCcore-13.2.0
libdeflate/1.19-GCCcore-13.2.0
libiconv/1.17-GCCcore-13.2.0
libidn2/2.3.2-GCCcore-13.2.0
libjpeg-turbo/3.0.1-GCCcore-13.2.0
libpng/1.6.40-GCCcore-13.2.0
libwebp/1.3.2-GCCcore-13.2.0
lz4/1.9.4-GCCcore-13.2.0
matplotlib/3.8.2-gfbf-2023b
netCDF/4.9.2-gompi-2023b
wget/1.21.4-GCCcore-13.2.0
zstd/1.5.5-GCCcore-13.2.0
other under _2023.06/software/linux/x8664/amd/zen4
no other files in tarball
Jun 15 09:29:50 UTC 2024 test result
:cry: FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
:white_check_mark: job output file slurm-115.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
boegel commented 2 weeks ago

Failed because downloading wcslib-7.11.tar.bz2 failed, I fixed that by uploading that source tarball to the bot account...

boegel commented 2 weeks ago

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

eessi-bot-aws[bot] commented 2 weeks ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4` from `boegel` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` resulted in: - no jobs were submitted
eessi-bot-aws[bot] commented 2 weeks ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4` from `boegel` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4` resulted in: - submitted job `118`, for details & status see https://github.com/EESSI/software-layer/pull/614#issuecomment-2169794235
eessi-bot-aws[bot] commented 2 weeks ago
New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_614/118 date job status comment
Jun 15 14:34:07 UTC 2024 submitted job id 118 awaits release by job manager
Jun 15 14:34:11 UTC 2024 released job awaits launch by Slurm scheduler
Jun 15 14:38:14 UTC 2024 running job 118 is running
Jun 15 17:50:17 UTC 2024 finished
Jun 15 17:50:17 UTC 2024 test result
:cry: FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
:white_check_mark: job output file slurm-118.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 15 19:48:59 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen4-1718473541.tar.gz to S3 bucket succeeded
ocaisa commented 2 weeks ago

Ingested, thanks @boegel !