search

h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.88k stars 1.99k forks source link

implement grid search using hyperparameter distributions #9514

Open exalate-issue-sync[bot] opened 1 year ago

exalate-issue-sync[bot] commented 1 year ago

For a search, the user should be able to say "gaussian with mean 10 and std dev 2" or "log uniform" for hyperparameter search.

exalate-issue-sync[bot] commented 1 year ago

Erin LeDell commented: Goal here would be to specify hyperparameter ranges like this: {code} gbm_params = {'learn_rate': uniform(0.01, 0.1), 'max_depth': randint(2, 10), 'sample_rate': uniform(0.5, 1.0), 'col_sample_rate': uniform(0.1, 1.0)} {code}

Instead of this: {code} gbm_params = {'learn_rate': [i 0.01 for i in range(1, 11)], 'max_depth': range(2, 11), 'sample_rate': [i 0.1 for i in range(5, 11)], 'col_sample_rate': [i * 0.1 for i in range(1, 11)]} {code}

h2o-ops commented 1 year ago

JIRA Issue Migration Info

Jira Issue: PUBDEV-2573 Assignee: Raymond Peck Reporter: Raymond Peck State: Open Fix Version: N/A Attachments: N/A Development PRs: N/A