ALRhub / clusterduck

clusterduck is a hydra launcher plugin for running jobs in batches on a SLURM cluster. It is intended for small tasks on clusters where jobs have exclusive access to a node, such that submitting a single task to a node would be wasteful.
12 stars 1 forks source link

Refactor resource management #2

Closed balazsgyenes closed 1 year ago

balazsgyenes commented 1 year ago

Refactor resource management with self-registering resource subclasses. Remove references to hydra from WorkerPool. Set start method back to fork and remove extra pickles from launcher. Restructure example with config group for platform. Remove pytorch operations from example. Rename config fields. Add isort config, update dependencies and README.