clusterduck is a hydra launcher plugin for running jobs in batches on a SLURM cluster. It is intended for small tasks on clusters where jobs have exclusive access to a node, such that submitting a single task to a node would be wasteful.
12
stars
1
forks
source link
Why are there soooooo many submitit processes? #14
I started a run for a single config, but on the node exist several hundred processes
python3 -u -m submitit.core._submit /home/...../submitit/%j
With the exact same name.
I started a run for a single config, but on the node exist several hundred processes
python3 -u -m submitit.core._submit /home/...../submitit/%jWith the exact same name.