RS-DAT / JupyterDaskOnSLURM

Apache License 2.0
16 stars 3 forks source link

Server vs local #38

Open fnattino opened 1 year ago

fnattino commented 1 year ago

Right now this repository needs to be cloned on both server and local sides. It would be ideal if one would have to dowload it only locally, so that users can tune parameters and scripts (dask configuration files, job submission scripts, environment file), with these being pushed to the supercomputer.

Also, right now it is not super clear which components are needed for the local setting and which for the remote:

fnattino commented 1 year ago

Related: the environment file here should probably only contain the minimal dependencies (Jupyter, Dask, dCache-related tools). User-specific packages could be added by modifying the local environment file, if this is then pushed to the remote for configuration. A different question is can we support multiple environments (#40 )?