JGCRI / gcam_cluster_utils

Utilities for running GCAM on a cluster or on the cloud.
0 stars 0 forks source link

Containerize Models #3

Open pralitp opened 1 year ago

pralitp commented 1 year ago

We would need to scan users local copies of GCAM etc and containerize them.

This implies we have Dockerfiles for each already.

The version a user wants to use could be aribitrary and in development. How do we tag them?

How do we want to sync them to remote environments? Docker has efficient solutions. But HPC won't have Docker.

sash19 commented 1 year ago

Another possible thing to consider here is that even if the user provides us with a container which has all the dependencies needed for their model, it is highly likely that dask itself isn't installed in that container so we either have to tell users to install dask or include installing dask in the user's container as part of bootstrapping.