Closed elemets closed 1 month ago
Approved. The addition of Bayesian Search with compatibility updates across Python 3.7-3.11
and integration with scikit-optimize
significantly enhances the functionality and flexibility of model_tuner
. The inclusion of BayesSearchCV
for hyperparameter tuning and minor bug fixes contribute to a more robust tool. Great work on expanding the feature set while ensuring cross-version stability.
[PR] Add Bayesian Search to Model Tuner with Support for Python 3.7 - 3.11
Overview
This pull request introduces support for Bayesian Search in
model_tuner
, along with updates to compatibility across Python versions 3.7 to 3.11. The update was initially contributed by @lshpaner, and we've now expanded it to also supportscikit-optimize
, allowing the use ofBayesSearchCV
for more efficient hyperparameter tuning.Key Changes
Support for Python Versions 3.7 - 3.11: Fixed compatibility issues across these Python versions, ensuring stable use of the model tuner in a wider range of environments.
Integration with
scikit-optimize
: The update enables the use ofBayesSearchCV
fromscikit-optimize
, allowing more sophisticated hyperparameter tuning. Instead of defining a fixed grid, you can now define a search space, and Bayesian search will find the best parameters within this space.Example:
Enable Bayesian Search for Cross-Validation
To run the Bayesian search, set the
bayesian
andkfold
variables in the model definition to True. This ensures that the Bayesian search operates within cross-validation.Minor Bug Fixes
We have removed the unused variable
feature_names
and we have renamedxgboost_early
toboost_early
to make it a more general variable name.