Optuna DDP with Slurm Cluster

optuna / optuna-examples

Examples for https://github.com/optuna/optuna

MIT License

634 stars 172 forks source link

Optuna DDP with Slurm Cluster #197

Closed asifmustafa87 closed 12 months ago

asifmustafa87 commented 1 year ago

I was wondering if there is any example for optuna hyperparameter tuning with multi gpu ddp for hyper parameter optimization in Slurm Cluster bacause I could not find one.

nzw0301 commented 12 months ago

As you can see in this repo, no. Optuna's github action does not use GPUs, so slum with GPUs would not be available soon.