search

Azure / azhpc-images

Azure HPC/AI VM Images
MIT License
95 stars 77 forks source link

azhpc-images using spack #248

Closed abhamidipati-msft closed 1 year ago

abhamidipati-msft commented 1 year ago

{ "spack": "0.20.0.dev0", "azcopy": "10.17.0", "lustre": "2.15.1-24-gbaa21ca", "mofed": "23.04-0.5.3.3", "cuda": "12.1.0", "nvidia": "525.105.17", "gdrcopy": "2.3", "nvidia_fabricmanager": "525_525.105.17-1", "intel_one_mkl": "2023.1.0", "hpcx": "2.15", "mvapich2": "2.3.7", "ompi": "4.1.5", "impi_2021": "2021.9.0", "nccl": "2.18.1-1", "moby": "20.10.24+azure-ubuntu22.04u1", "nvidia_docker": "20.10.24+azure-1", "dcgm": "3.1.8", "waagent": "2.9.0.4", "moneo": "0.2.3" }

ltalirz commented 1 year ago

This is very interesting to me, has there been a decision in the team to move to spack for installing the libraries in the image?

This would have obvious benefits for downstream packages built with spack.

Furthermore, we've been in contact with the spack core developers who would be interested in setting up a public binary cache for Azure as well. So far, creating a build cache on top of the azhpc images, such as AlmaLinux 8.7 HPC, would have been problematic since the HPC libraries (e.g. MPI library) would have needed to be declared as "external", making it difficult to (automatically) handle compatibility as the image evolves. With this PR guess this issue would go away (?). Feel free to reach out to me for any conversation in this direction.

rafsalas19 commented 1 year ago

Just a general comment: there are a lot of changes here. Hopefully, we can/have test this in a way where all the components that were touched are verified to work.

abhamidipati-msft commented 1 year ago

@rafsalas19 Yes, this PR is only functional for Ubuntu 22.04 scripts. And is tested.

ltalirz commented 1 year ago

With this merged, is the plan to extend this build procedure to other images as well, such as AlmaLinux 8.7?

ltalirz commented 1 year ago

With this merged, is the plan to extend this build procedure to other images as well, such as AlmaLinux 8.7?

abhamidipati-msft commented 1 year ago

@ltalirz yes, the plan is to extend this to other images as well

ltalirz commented 1 year ago

Fantastic, very much looking forward to this!