EESSI / software-layer

Software layer of the EESSI project
https://eessi.github.io/docs/software_layer
GNU General Public License v2.0
23 stars 46 forks source link

Allow `EESSI-extend` as a loaded module when using EasyBuild #578

Closed ocaisa closed 3 months ago

ocaisa commented 4 months ago

Also edited the umask for various scenarios:

eessi-bot[bot] commented 4 months ago

Instance eessi-bot-mc-aws is configured to build:

eessi-bot[bot] commented 4 months ago

Instance eessi-bot-mc-azure is configured to build:

bedroge commented 3 months ago

@ocaisa I guess this is ready to be (re)built?

ocaisa commented 3 months ago

@bedroge Yes, I think so. The controversial thing is whether these settings for the umask are reasonable? The user one is quite restrictive

bedroge commented 3 months ago

@bedroge Yes, I think so. The controversial thing is whether these settings for the umask are reasonable? The user one is quite restrictive

@ocaisa Looks fine to me. We can explain in the docs what the defaults are and how you can override them manually?

bedroge commented 3 months ago

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 bot: build repo:eessi.io-2023.06-software arch:x86_64/generic bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512

eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - submitted job `12253`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657309 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - submitted job `12254`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657378 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - submitted job `12255`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657490 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - submitted job `12256`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657592 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - submitted job `12257`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657681 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - submitted job `12258`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657783 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - submitted job `12259`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657886 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - submitted job `12260`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154657972
eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - no jobs were submitted
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12253 date job status comment
Jun 07 11:36:42 UTC 2024 submitted job id 12253 awaits release by job manager
Jun 07 11:37:07 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:38:22 UTC 2024 running job 12253 is running
Jun 07 11:44:49 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12253.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1717760292.tar.gzsize: 0 MiB (2832 bytes)
entries: 3
modules under 2023.06/software/linux/aarch64/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Jun 07 11:44:49 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12253.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12254 date job status comment
Jun 07 11:36:46 UTC 2024 submitted job id 12254 awaits release by job manager
Jun 07 11:37:09 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:42:28 UTC 2024 running job 12254 is running
Jun 07 11:49:12 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12254.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_n1-1717760562.tar.gzsize: 0 MiB (2839 bytes)
entries: 3
modules under _2023.06/software/linux/aarch64/neoversen1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversen1/software
no software packages in tarball
other under _2023.06/software/linux/aarch64/neoversen1
no other files in tarball
Jun 07 11:49:12 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12254.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12255 date job status comment
Jun 07 11:36:50 UTC 2024 submitted job id 12255 awaits release by job manager
Jun 07 11:37:11 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:42:30 UTC 2024 running job 12255 is running
Jun 07 11:47:03 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12255.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1717760551.tar.gzsize: 0 MiB (2837 bytes)
entries: 3
modules under _2023.06/software/linux/aarch64/neoversev1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversev1/software
no software packages in tarball
other under _2023.06/software/linux/aarch64/neoversev1
no other files in tarball
Jun 07 11:47:03 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12255.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12256 date job status comment
Jun 07 11:36:54 UTC 2024 submitted job id 12256 awaits release by job manager
Jun 07 11:37:16 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:43:39 UTC 2024 running job 12256 is running
Jun 07 11:49:15 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12256.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1717760632.tar.gzsize: 0 MiB (2835 bytes)
entries: 3
modules under _2023.06/software/linux/x8664/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/generic/software
no software packages in tarball
other under _2023.06/software/linux/x8664/generic
no other files in tarball
Jun 07 11:49:15 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12256.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12257 date job status comment
Jun 07 11:36:58 UTC 2024 submitted job id 12257 awaits release by job manager
Jun 07 11:37:12 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:43:35 UTC 2024 running job 12257 is running
Jun 07 11:49:14 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12257.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1717760629.tar.gzsize: 0 MiB (2830 bytes)
entries: 3
modules under _2023.06/software/linux/x8664/amd/zen2/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen2/software
no software packages in tarball
other under _2023.06/software/linux/x8664/amd/zen2
no other files in tarball
Jun 07 11:49:14 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12257.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12258 date job status comment
Jun 07 11:37:02 UTC 2024 submitted job id 12258 awaits release by job manager
Jun 07 11:37:14 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:43:37 UTC 2024 running job 12258 is running
Jun 07 11:48:09 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12258.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1717760622.tar.gzsize: 0 MiB (2825 bytes)
entries: 3
modules under _2023.06/software/linux/x8664/amd/zen3/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen3/software
no software packages in tarball
other under _2023.06/software/linux/x8664/amd/zen3
no other files in tarball
Jun 07 11:48:09 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12258.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12259 date job status comment
Jun 07 11:37:06 UTC 2024 submitted job id 12259 awaits release by job manager
Jun 07 11:38:18 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:43:41 UTC 2024 running job 12259 is running
Jun 07 11:50:19 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12259.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-haswell-1717760685.tar.gzsize: 0 MiB (2835 bytes)
entries: 3
modules under _2023.06/software/linux/x8664/intel/haswell/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/intel/haswell/software
no software packages in tarball
other under _2023.06/software/linux/x8664/intel/haswell
no other files in tarball
Jun 07 11:50:19 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12259.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12260 date job status comment
Jun 07 11:37:10 UTC 2024 submitted job id 12260 awaits release by job manager
Jun 07 11:38:20 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 11:44:48 UTC 2024 running job 12260 is running
Jun 07 11:49:17 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12260.out
:x: found message matching ERROR:
:x: found message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1717760695.tar.gzsize: 0 MiB (2842 bytes)
entries: 3
modules under _2023.06/software/linux/x86_64/intel/skylakeavx512/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x86_64/intel/skylakeavx512/software
no software packages in tarball
other under _2023.06/software/linux/x86_64/intel/skylakeavx512
no other files in tarball
Jun 07 11:49:17 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12260.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
bedroge commented 3 months ago

Hmm... I think we're hitting this issue again: https://github.com/EESSI/software-layer/issues/556. The directory seems empty and writable, but there's some stuff showing up if you check one of the old subdirectories:

bedroge@x86-64-amd-zen3-node2 ~ $ ls -la /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/EESSI-extend/2023.06-easybuild/    
total 0
drwxrwxr-x 2 bedroge bedroge 42 Jun  7 11:54 .
drwxr-xr-x 3 bedroge bedroge 31 Jun  7 11:54 ..
bedroge@x86-64-amd-zen3-node2 ~ $ ls -la /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/EESSI-extend/2023.06-easybuild/easybuild/
total 62
dr-xr-xr-x 3 bedroge bedroge  4096 May  7 13:41 .
drwxrwxr-x 2 bedroge bedroge    42 Jun  7 11:54 ..
-r--r--r-- 1 bedroge bedroge  2754 May  7 13:41 EESSI-extend-2023.06-easybuild-easybuild-devel
-r--r--r-- 1 bedroge bedroge  7976 May  7 13:28 EESSI-extend-2023.06-easybuild.eb
-r--r--r-- 1 bedroge bedroge 22875 May  7 13:41 easybuild-EESSI-extend-2023.06-20240507.134135.log.bz2
-rw-rw-r-- 1 bedroge bedroge 19051 May  7 13:41 easybuild-EESSI-extend-2023.06-20240507.134135_test_report.md
dr-xr-xr-x 4 bedroge bedroge  4096 May  7 13:41 reprod
bedroge commented 3 months ago

Added user write permissions to the EESSI-extend installation dirs, trying again...

bedroge commented 3 months ago

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 bot: build repo:eessi.io-2023.06-software arch:x86_64/generic bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512

eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - submitted job `12263`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154703604 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - submitted job `12264`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154703697 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - submitted job `12265`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154703797 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - submitted job `12266`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154703899 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - submitted job `12267`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154704007 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - submitted job `12268`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154704153 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - submitted job `12269`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154704266 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - submitted job `12270`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154704375
eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - no jobs were submitted
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12263 date job status comment
Jun 07 12:08:06 UTC 2024 submitted job id 12263 awaits release by job manager
Jun 07 12:08:23 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:14:12 UTC 2024 running job 12263 is running
Jun 07 12:20:45 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12263.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1717762469.tar.gzsize: 0 MiB (63201 bytes)
entries: 21
modules under 2023.06/software/linux/aarch64/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under 2023.06/software/linux/aarch64/generic/software
EESSI-extend/2023.06-easybuild
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Jun 07 12:20:45 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12263.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12264 date job status comment
Jun 07 12:08:10 UTC 2024 submitted job id 12264 awaits release by job manager
Jun 07 12:08:25 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:09:44 UTC 2024 running job 12264 is running
Jun 07 12:15:25 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12264.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_n1-1717762169.tar.gzsize: 0 MiB (64411 bytes)
entries: 21
modules under _2023.06/software/linux/aarch64/neoversen1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversen1/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/aarch64/neoversen1
no other files in tarball
Jun 07 12:15:25 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12264.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12265 date job status comment
Jun 07 12:08:14 UTC 2024 submitted job id 12265 awaits release by job manager
Jun 07 12:08:29 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:09:46 UTC 2024 running job 12265 is running
Jun 07 12:14:18 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12265.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1717762158.tar.gzsize: 0 MiB (63788 bytes)
entries: 21
modules under _2023.06/software/linux/aarch64/neoversev1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversev1/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/aarch64/neoversev1
no other files in tarball
Jun 07 12:14:18 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12265.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12266 date job status comment
Jun 07 12:08:18 UTC 2024 submitted job id 12266 awaits release by job manager
Jun 07 12:08:31 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:09:47 UTC 2024 running job 12266 is running
Jun 07 12:15:27 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12266.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1717762161.tar.gzsize: 0 MiB (63230 bytes)
entries: 21
modules under _2023.06/software/linux/x8664/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/generic/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/generic
no other files in tarball
Jun 07 12:15:27 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12266.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12267 date job status comment
Jun 07 12:08:22 UTC 2024 submitted job id 12267 awaits release by job manager
Jun 07 12:09:35 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:10:52 UTC 2024 running job 12267 is running
Jun 07 12:16:33 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12267.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1717762230.tar.gzsize: 0 MiB (63702 bytes)
entries: 21
modules under _2023.06/software/linux/x8664/amd/zen2/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen2/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/amd/zen2
no other files in tarball
Jun 07 12:16:33 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12267.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12268 date job status comment
Jun 07 12:08:26 UTC 2024 submitted job id 12268 awaits release by job manager
Jun 07 12:09:38 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:15:23 UTC 2024 running job 12268 is running
Jun 07 12:20:47 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12268.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1717762544.tar.gzsize: 0 MiB (63229 bytes)
entries: 21
modules under _2023.06/software/linux/x8664/amd/zen3/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen3/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/amd/zen3
no other files in tarball
Jun 07 12:20:47 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12268.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12269 date job status comment
Jun 07 12:08:32 UTC 2024 submitted job id 12269 awaits release by job manager
Jun 07 12:09:40 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:10:55 UTC 2024 running job 12269 is running
Jun 07 12:16:34 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12269.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-haswell-1717762241.tar.gzsize: 0 MiB (63468 bytes)
entries: 21
modules under _2023.06/software/linux/x8664/intel/haswell/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/intel/haswell/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/intel/haswell
no other files in tarball
Jun 07 12:16:34 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12269.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12270 date job status comment
Jun 07 12:08:36 UTC 2024 submitted job id 12270 awaits release by job manager
Jun 07 12:09:42 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:10:56 UTC 2024 running job 12270 is running
Jun 07 12:15:29 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12270.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1717762241.tar.gzsize: 0 MiB (63061 bytes)
entries: 21
modules under _2023.06/software/linux/x86_64/intel/skylakeavx512/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x86_64/intel/skylakeavx512/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x86_64/intel/skylakeavx512
no other files in tarball
Jun 07 12:15:29 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12270.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
bedroge commented 3 months ago

Still some permission issues. Also recursively changed the ownership of all EESSI-extend directories now.

bedroge commented 3 months ago

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - submitted job `12273`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154732450
eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - no jobs were submitted
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12273 date job status comment
Jun 07 12:26:24 UTC 2024 submitted job id 12273 awaits release by job manager
Jun 07 12:26:56 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 12:27:58 UTC 2024 running job 12273 is running
Jun 07 12:32:10 UTC 2024 finished
:cry: FAILURE (click triangle for details)
Details
:white_check_mark: job output file slurm-12273.out
:x: found message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1717763286.tar.gzsize: 0 MiB (64527 bytes)
entries: 21
modules under _2023.06/software/linux/x8664/amd/zen3/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen3/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/amd/zen3
no other files in tarball
Jun 07 12:32:10 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12273.out
:x: found message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
bedroge commented 3 months ago

Still some permission issues :disappointed:

easybuild.tools.build_log.EasyBuildError: "Failed to chmod/chown several paths: ['/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/EESSI-extend/2023.06-easybuild/easybuild/easybuild-EESSI-extend-2023.06-20240507.134135.log.bz2', '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/EESSI-extend/2023.06-easybuild/easybuild/easybuild-EESSI-extend-2023.06-20240507.134135_test_report.md'] (last error: [Errno 13] Permission denied: '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/EESSI-extend/2023.06-easybuild/easybuild/easybuild-EESSI-extend-2023.06-20240507.134135_test_report.md')"

edit: I'll remove some files (they're not required to load the module, so shouldn't break anything) to get this built and deployed.

bedroge commented 3 months ago

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 bot: build repo:eessi.io-2023.06-software arch:x86_64/generic bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512

eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-aws (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - submitted job `12276`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795241 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - submitted job `12277`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795356 - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - submitted job `12278`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795479 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - submitted job `12279`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795594 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - submitted job `12280`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795708 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - submitted job `12281`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795840 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - submitted job `12282`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154795949 - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - submitted job `12283`, for details & status see https://github.com/EESSI/software-layer/pull/578#issuecomment-2154796072
eessi-bot[bot] commented 3 months ago
Updates by the bot instance eessi-bot-mc-azure (click for details) - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` - received bot command `build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/generic` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/generic` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` - received bot command `build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512` from `bedroge` - expanded format: `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/generic` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell` resulted in: - no jobs were submitted - handling command `build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512` resulted in: - no jobs were submitted
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12276 date job status comment
Jun 07 13:03:53 UTC 2024 submitted job id 12276 awaits release by job manager
Jun 07 13:04:45 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:05 UTC 2024 running job 12276 is running
Jun 07 13:13:23 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12276.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1717765565.tar.gzsize: 0 MiB (52894 bytes)
entries: 15
modules under 2023.06/software/linux/aarch64/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under 2023.06/software/linux/aarch64/generic/software
EESSI-extend/2023.06-easybuild
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Jun 07 13:13:23 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12276.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:17:43 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1717765565.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12277 date job status comment
Jun 07 13:03:57 UTC 2024 submitted job id 12277 awaits release by job manager
Jun 07 13:04:47 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:08 UTC 2024 running job 12277 is running
Jun 07 13:13:24 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12277.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_n1-1717765561.tar.gzsize: 0 MiB (50996 bytes)
entries: 15
modules under _2023.06/software/linux/aarch64/neoversen1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversen1/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/aarch64/neoversen1
no other files in tarball
Jun 07 13:13:24 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12277.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:18:03 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-neoverse_n1-1717765561.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12278 date job status comment
Jun 07 13:04:01 UTC 2024 submitted job id 12278 awaits release by job manager
Jun 07 13:04:50 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:10 UTC 2024 running job 12278 is running
Jun 07 13:12:12 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12278.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1717765580.tar.gzsize: 0 MiB (50778 bytes)
entries: 15
modules under _2023.06/software/linux/aarch64/neoversev1/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/aarch64/neoversev1/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/aarch64/neoversev1
no other files in tarball
Jun 07 13:12:12 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12278.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:18:22 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-neoverse_v1-1717765580.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12279 date job status comment
Jun 07 13:04:05 UTC 2024 submitted job id 12279 awaits release by job manager
Jun 07 13:04:57 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:15 UTC 2024 running job 12279 is running
Jun 07 13:12:15 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12279.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1717765552.tar.gzsize: 0 MiB (51001 bytes)
entries: 15
modules under _2023.06/software/linux/x8664/generic/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/generic/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/generic
no other files in tarball
Jun 07 13:12:15 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12279.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:18:42 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1717765552.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12280 date job status comment
Jun 07 13:04:09 UTC 2024 submitted job id 12280 awaits release by job manager
Jun 07 13:04:52 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:12 UTC 2024 running job 12280 is running
Jun 07 13:12:13 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12280.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1717765598.tar.gzsize: 0 MiB (51619 bytes)
entries: 15
modules under _2023.06/software/linux/x8664/amd/zen2/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen2/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/amd/zen2
no other files in tarball
Jun 07 13:12:13 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12280.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:19:01 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1717765598.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12281 date job status comment
Jun 07 13:04:14 UTC 2024 submitted job id 12281 awaits release by job manager
Jun 07 13:04:55 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:11:02 UTC 2024 running job 12281 is running
Jun 07 13:16:32 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12281.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1717765863.tar.gzsize: 0 MiB (51089 bytes)
entries: 15
modules under _2023.06/software/linux/x8664/amd/zen3/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/amd/zen3/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/amd/zen3
no other files in tarball
Jun 07 13:16:32 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12281.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:19:21 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen3-1717765863.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12282 date job status comment
Jun 07 13:04:18 UTC 2024 submitted job id 12282 awaits release by job manager
Jun 07 13:04:59 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:18 UTC 2024 running job 12282 is running
Jun 07 13:12:17 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12282.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-haswell-1717765583.tar.gzsize: 0 MiB (52599 bytes)
entries: 15
modules under _2023.06/software/linux/x8664/intel/haswell/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x8664/intel/haswell/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x8664/intel/haswell
no other files in tarball
Jun 07 13:12:17 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12282.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:19:43 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-haswell-1717765583.tar.gz to S3 bucket succeeded
eessi-bot[bot] commented 3 months ago
New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.06/pr_578/12283 date job status comment
Jun 07 13:04:22 UTC 2024 submitted job id 12283 awaits release by job manager
Jun 07 13:05:02 UTC 2024 released job awaits launch by Slurm scheduler
Jun 07 13:06:20 UTC 2024 running job 12283 is running
Jun 07 13:12:19 UTC 2024 finished
:grin: SUCCESS (click triangle for details)
Details
:white_check_mark: job output file slurm-12283.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching FAILED:
:white_check_mark: no message matching required modules missing:
:white_check_mark: found message(s) matching No missing installations
:white_check_mark: found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1717765596.tar.gzsize: 0 MiB (51809 bytes)
entries: 15
modules under _2023.06/software/linux/x86_64/intel/skylakeavx512/modules/all
EESSI-extend/2023.06-easybuild.lua
software under _2023.06/software/linux/x86_64/intel/skylakeavx512/software
EESSI-extend/2023.06-easybuild
other under _2023.06/software/linux/x86_64/intel/skylakeavx512
no other files in tarball
Jun 07 13:12:19 UTC 2024 test result
:grin: SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
:white_check_mark: job output file slurm-12283.out
:white_check_mark: no message matching ERROR:
:white_check_mark: no message matching [\s*FAILED\s*].*Ran .* test case
Jun 07 13:20:03 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1717765596.tar.gz to S3 bucket succeeded
bedroge commented 3 months ago

Deployed, and works as expected:

{EESSI 2023.06} $ ml EESSI-extend
-- Using /tmp/$USER as a temporary working directory for installations, you can
override this by setting the environment variable WORKING_DIR and reloading the
module (e.g., /dev/shm is a common option) 
Configuring for use of EESSI_USER_INSTALL under /home/bob/eessi
-- To create installations for EESSI, you _must_ have write permissions to
/home/bob/eessi/versions/2023.06/software/linux/x86_64/intel/haswell 
-- You may wish to configure a sources directory for EasyBuild (for example,
via setting the environment variable EASYBUILD_SOURCEPATH) to allow you to
reuse existing sources for packages. 

{EESSI 2023.06} $ echo $EASYBUILD_ALLOW_LOADED_MODULES 
EasyBuild,EESSI-extend