xadrianzetx / optuna-distributed

Distributed hyperparameter optimization made easy
MIT License
34 stars 1 forks source link

Default to `multiprocessing` backend when `LocalCluster` is used #44

Closed xadrianzetx closed 2 years ago

xadrianzetx commented 2 years ago

Is your feature request related to a problem? Please describe. Cleanup after timeouts or interrupts is problematic when LocalCluster is used and it gets even more convoluted when we consider other environments such as jupyter notebook.

Describe the solution you'd like All these problems can be avoided if we default to multiprocessing backend when user only wants local asynchronous optimization.

Describe alternatives you've considered Keep the current design and cover new edge cases in distributed optimization manager.

Additional context