h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.87k stars 1.99k forks source link

Support for weighted hyperparameters in random grids #6525

Open exalate-issue-sync[bot] opened 1 year ago

exalate-issue-sync[bot] commented 1 year ago

When running a RGS, we may want to privilege some parameters values over others. This can be “partly done” today by duplicating a parameter value for example, but the result is not 100% as expected:

To avoid the issues above, I suggest to offer the possibility to provide explicit weights to some parameters through a {{meta}} parameter:

{code:none}param_dummy = ['A', 'B'] param_dummy$weights = [2, 1]{code}

the walkers supporting weights (currently only {{RandomDiscreteValueWalker}}) will then be able to extract those meta-params, validate them (ensure ints, same size as corresponding param…), and use them to tweak the random hyper-param selector.

h4. Benefits of this syntax (meta-param) over additional method parameter:

h4. Drawbacks of this syntax:

h2o-ops commented 1 year ago

JIRA Issue Details

Jira Issue: PUBDEV-8917 Assignee: Sebastien Poirier Reporter: Sebastien Poirier State: Open Fix Version: 3.42.0.1 Attachments: N/A Development PRs: N/A