search

yandex / rep

Machine Learning toolbox for Humans
http://yandex.github.io/rep/
Other
687 stars 144 forks source link

Test GP-based optimization #13

Closed arogozhnikov closed 9 years ago

arogozhnikov commented 9 years ago

Build an additional test that GaussianProcess optimization works fine.

For batch optimization, probably some improvement is possible, which also minimizes an overall variance as well as looking for most optimal model. (Need to check if some well-tested implementation exists).

Sklearn's gaussian processes don't support variance of measurements, which probably could improve search.

arogozhnikov commented 9 years ago

related link: http://arxiv.org/pdf/1206.2944v2.pdf

arogozhnikov commented 9 years ago

Currently simple GP-optimization is demonstrated in https://github.com/yandex/rep/blob/master/howto/03-howto-gridsearch.ipynb via RegressionOptimization, but maybe some specific solutions will be added later.