search

ACCESS-NRI / payu-condaenv

A conda (mamba) python environment for running payu
Apache License 2.0
0 stars 2 forks source link

Create deployment workflow to NCI #2

Closed aidanheerdegen closed 11 months ago

aidanheerdegen commented 12 months ago

Deployment should be relatively straightforward if we create an environment in a workflow and use conda-pack to create a relocatable archive that we copy to NCI and unpack there.

Here is an example of something similar (for reproducible research)

https://dev.to/epassaro/keep-your-research-reproducible-with-conda-pack-and-github-actions-339n

conda-pack also has a python API, or can use the CLI.

aidanheerdegen commented 11 months ago

Should also consider using containers, as discussed here https://github.com/ACCESS-NRI/payu-condaenv/issues/4#issuecomment-1813989028

aidanheerdegen commented 11 months ago

One possible catch with containers is that payu currently passes the path to the payu executable to PBS jobs as an environment variable.

I don't think that would work if we used containers. It would require loading the module that runs the container and makes it available on the filesystem.