{ai}[foss/2023a] vLLM v0.4.0, xformers v0.0.23.post1 w/ CUDA 12.1.1

easybuilders / easybuild-easyconfigs

A collection of easyconfig files that describe which software to build using which build options with EasyBuild.

https://easybuild.io

GNU General Public License v2.0

382 stars 702 forks source link

{ai}[foss/2023a] vLLM v0.4.0, xformers v0.0.23.post1 w/ CUDA 12.1.1 #21901

Open pavelToman opened 3 days ago

pavelToman commented 3 days ago

(created using eb --new-pr) resolves https://github.com/vscentrum/vsc-software-stack/issues/257

pavelToman commented 3 days ago

@boegelbot please test @ generoso

boegelbot commented 3 days ago

@pavelToman: Request for testing this PR well received on login1

PR test command 'EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:
```
Submitted batch job 14752
```

Test results coming soon (I hope)...

*- notification for comment with ID 2493620067 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*

boegelbot commented 3 days ago

Test report by @boegelbot FAILED Build succeeded for 0 out of 2 (2 easyconfigs in total) cns1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8 See https://gist.github.com/boegelbot/c97058e8b2491ceb904fdd671f791454 for a full test report.

pavelToman commented 3 days ago

Test report by @pavelToman SUCCESS Build succeeded for 2 out of 2 (2 easyconfigs in total) node4001.donphan.os - Linux RHEL 8.8, x86_64, Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz, 1 x NVIDIA NVIDIA A2, 545.23.08, Python 3.6.8 See https://gist.github.com/pavelToman/d5b5907f00d8d1931aa79ff621a4f9db for a full test report.

pavelToman commented 3 days ago

@boegelbot please test @ jsc-zen3

boegelbot commented 3 days ago

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:
```
Submitted batch job 5319
```

Test results coming soon (I hope)...

*- notification for comment with ID 2493684897 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*

boegel commented 3 days ago

@boegelbot please test @ generoso CORE_CNT=16

boegelbot commented 3 days ago

@boegel: Request for testing this PR well received on login1

PR test command 'EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:
```
Submitted batch job 14753
```

Test results coming soon (I hope)...

*- notification for comment with ID 2493710277 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*

boegelbot commented 3 days ago

Test report by @boegelbot SUCCESS Build succeeded for 2 out of 2 (2 easyconfigs in total) jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18 See https://gist.github.com/boegelbot/9c98bffcb2adae325abb631c71d593b9 for a full test report.

boegelbot commented 3 days ago

Test report by @boegelbot SUCCESS Build succeeded for 2 out of 2 (2 easyconfigs in total) cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8 See https://gist.github.com/boegelbot/4473799ad4a42541481840893d2f4100 for a full test report.

pavelToman commented 3 days ago

Test report by @boegelbot FAILED Build succeeded for 0 out of 2 (2 easyconfigs in total) cns1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8 See https://gist.github.com/boegelbot/c97058e8b2491ceb904fdd671f791454 for a full test report.

For compiling of xformers you need more memory than default one on generoso

pavelToman commented 3 days ago

@boegelbot please test @ jsc-zen3-a100

boegelbot commented 3 days ago

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=8 --partition=jsczen3g --gres=gpu:1 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:
```
Submitted batch job 5322
```

Test results coming soon (I hope)...

*- notification for comment with ID 2493823588 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*