search

NOAA-GSL / ExascaleWorkflowSandbox

Other
2 stars 2 forks source link

Add capability to use AWS S3 bucket as a spack binary cache #54

Closed christopherwharrop-noaa closed 8 months ago

christopherwharrop-noaa commented 8 months ago

This PR adds modifications to the spack-stack Dockerfile creation script and the CI workflow definition that allow pushing of spack binaries to a binary build cache stored an AWS S3 bucket. This relies on a completed build in order for binaries to be pushed to the cache. However, once they are there, it will speed building of spack-stack container by orders of magnitude. The modifications add a template that can be used in conjunction with github secrets to configure the mirror in the container at build time. The CI and Dockerfile make use of the mirror for pushing packages and using it for retrieving ones already built.

christopherwharrop-noaa commented 8 months ago

Hi @NaureenBharwaniNOAA, this is ready for your review when you return.