ML AutoML HPO BO BOHB - Githubissues

junxnone / aiwiki

AI Wiki

https://junxnone.github.io/aiwiki

18 stars 2 forks source link

ML AutoML HPO BO BOHB #219

Open junxnone opened 3 years ago

junxnone commented 3 years ago

Reference

2015 SHA - Successive Halving Algorithm Non-stochastic Best Arm Identification and Hyperparameter Optimization
2018 ASHA A System for Massively Parallel Hyperparameter Tuning
2016 Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization
2018 BOHB BOHB: Robust and Efficient Hyperparameter Optimization at Scale
2018 Practical Hyperparameter Optimization for Deep Learning
VEGA-HPO
Massively Parallel Hyperparameter Optimization
NNI - BOHBO

Brief

BOHB - Bayesian Optimization and Hyperband
属于动态资源分配/Dynamic Resource Allocation

Hyperband

Hyperband 是对 Successive Halving 的扩展

Successive Halving	Hyperband

SHA
ASHA

BOHB Algorithm

junxnone commented 3 years ago

junxnone/tech-io#684