This PR fixes the two small issues that arise on cluster when running in parallel mode.
There are two new arguments:
--parallel-memory which controls the total amount of memory allowed for ray (4Gb by default)
--parallel-temp-dir which sets the temporary directory for ray to use (defaults to None, which further defaults to /usr/tmp/ by ray itself I believe)
I lost track who uses which slurm scripts, so haven't updated any, but nudge me if you want something specific changed. I'd say a typical usage would be:
This PR fixes the two small issues that arise on cluster when running in parallel mode.
There are two new arguments:
--parallel-memory
which controls the total amount of memory allowed forray
(4Gb by default)--parallel-temp-dir
which sets the temporary directory forray
to use (defaults toNone
, which further defaults to/usr/tmp/
byray
itself I believe)I lost track who uses which slurm scripts, so haven't updated any, but nudge me if you want something specific changed. I'd say a typical usage would be:
But this should at least solve the memory issue out of the box; the
temp_dir
thing, if persists, set it manually.