search

jrbourbeau / dask-optuna

Scale Optuna with Dask
https://jrbourbeau.github.io/dask-optuna/
MIT License
35 stars 6 forks source link

[QUESTION] Can sqlite be used for multi-node multi-GPU runs? #17

Closed Nanthini10 closed 3 years ago

Nanthini10 commented 3 years ago

For the storage, what would be the recommended way to run a multi-node experiment?

mrocklin commented 3 years ago

Hi @Nanthini10 !

Yes, you can use any Optuna storage within a DaskStorage and it will be multi-node safe. This includes sqlite or in-process.

The example in the README would work fine in a multi-node environment if you switched out the local Client for a Client pointing to a remote system.

mrocklin commented 3 years ago

Or, more generally, there are no special considerations that you need to take with dask-optuna when running on multiple nodes, other than the normal considerations you would take like making sure that you have the same software environments everywhere. The dask-optuna code itself is agnostic to being run on one node or on many.

Nanthini10 commented 3 years ago

Thanks for the clarification, @mrocklin.