clusterduck is a hydra launcher plugin for running jobs in batches on a SLURM cluster. It is intended for small tasks on clusters where jobs have exclusive access to a node, such that submitting a single task to a node would be wasteful.
Manually pickle task function in launching process.
Lazily unpickle task function only inside workers to prevent imports from modifying state.
Update README and dependencies.
Manually pickle task function in launching process. Lazily unpickle task function only inside workers to prevent imports from modifying state. Update README and dependencies.