search

ALRhub / clusterduck

clusterduck is a hydra launcher plugin for running jobs in batches on a SLURM cluster. It is intended for small tasks on clusters where jobs have exclusive access to a node, such that submitting a single task to a node would be wasteful.
12 stars 1 forks source link

Feature request: Dryrun #5

Open ScheiklP opened 1 year ago

ScheiklP commented 1 year ago

Would it be possible to add a Dryrun option?

I would like to be able to call python3 train.py --multirun --dryrun to get a list of all the jobs that would have been submitted.

balazsgyenes commented 1 year ago

That's an interesting idea, but rather something to implement at the Hydra level. In particular, the launcher doesn't typically have access to command-line flags like "--dryrun". Could you open a feature request in the hydra repo and link it here? If there is interest then I wouldn't even mind writing the code.

ScheiklP commented 1 year ago

https://github.com/facebookresearch/hydra/issues/2759