sjdv1982 / seamless

Seamless is a framework to set up reproducible computations (and visualizations) that respond to changes in cells. Cells contain the input data as well as the source code of the computations, and all cells can be edited interactively.
http://sjdv1982.github.io/seamless
Other
20 stars 6 forks source link

seamless-conda-env-* bare metal mode #212

Closed sjdv1982 closed 1 year ago

sjdv1982 commented 1 year ago

This is to let jobless launch run-transformation inside a conda environment without any containerization.

Create a baremetal/ subfolder in seamless-tools/seamless-cli/ with the same files, similar as for singularity/. Then create type="generic",backend="shell",sub_backend="baremetal" and type="generic",backend="slurm",sub_backend="baremetal" settings for jobless.

Use the same seamless-minimal environments as in the Docker/Singularity version, but seamless-conda-env-export will instead install a new environment using /seamless/seamless-minimal/environment.yml

Since seamless-minimal environments do not contain Seamless, SEAMLESSDIR (and SEAMLESSTOOLSDIR?) must be specified when running seamless-conda-env-export. Also in jobless.

This is most practical to test jobless with a development version of Seamless that is not yet in a Singularity image. Seamless can then easily be modified and directly tested with jobless.

Needed for the rprod project.

sjdv1982 commented 1 year ago

done in https://github.com/sjdv1982/seamless-tools/commit/a989dfff03d213c5d3bd33af02e768a562227d5c