make it flexible for running jobs on OSSC and bare-metal snellius (what is the best way to find out whether a script is being run on the ossc or on snellius?)
Steps:
on OSSC and in this repository, create directory slurm_setup/, and then create files modules.sh and venv.sh
on OSSC, move the virtual environments from root into dedicated folder virtual_envs
in this repo, the slurm scripts should follow the same conventions
(common location for logs -- in the future) -- see #27
common names for log files, ie jobname.jobid.err and *.out as is currently done in some scripts (I'm open to alternatives)
declare local variables and load
declare PREFIX="/gpfs/ostor/ossc9424/homedir/"
declare VENV="ossc_new" # the name of the virtual environment
source "$PREFIX"/slurm_setup/modules.sh
source "$PREFIX"/slurm_setup/venv.sh
# run scripts
work on this once branch pipeline_parallel is merged.
goal:
Steps:
slurm_setup/
, and then create filesmodules.sh
andvenv.sh
modules.sh
should callmodule load xyz
in ordervenv.sh
callssource "$PREFIX"/virtual_envs/"$VENV"/bin/activate
virtual_envs
in this repo, the slurm scripts should follow the same conventions
jobname.jobid.err
and*.out
as is currently done in some scripts (I'm open to alternatives)declare local variables and load
work on this once branch
pipeline_parallel
is merged.