search

Epistimio / orion

Asynchronous Distributed Hyperparameter Optimization.
https://orion.readthedocs.io
Other
283 stars 52 forks source link

TPE will not complete when the search space is small #621

Closed donglinjy closed 3 years ago

donglinjy commented 3 years ago

When the space it too small, tpe could hang at here trying to propose new points. https://github.com/Epistimio/orion/blob/5cfa9d6ad9fce7457e05187adc30181733e7c404/src/orion/algo/tpe.py#L315

This is low priority as if the search space is too small, user should just use random or gridsearch.

bouthilx commented 3 years ago

Related to #598

bouthilx commented 3 years ago

Is this handled by this line? https://github.com/Epistimio/orion/blob/5cfa9d6ad9fce7457e05187adc30181733e7c404/src/orion/algo/tpe.py#L322

donglinjy commented 3 years ago

this should be duplicated as and fixed in https://github.com/Epistimio/orion/issues/679. Although as mentioned, it may be necessary to have a chance to explore the full space before giving up.

bouthilx commented 3 years ago

Ok I think we can close this one now.