choshin84 / learning_memo

personal learning memo

0 stars 0 forks source link

Parameter tuning: Basic understanding #27

Open choshin84 opened 5 years ago

choshin84 commented 5 years ago

Tweet summary

(GBM) Separate tree based parameters and Boosting parameters (XGB/LGBM/Cat) Add regularization parameters

Useful link

https://www.analyticsvidhya.com/blog/2016/02/complete-guide-parameter-tuning-gradient-boosting-gbm-python/ https://www.analyticsvidhya.com/blog/2016/03/complete-guide-parameter-tuning-xgboost-with-codes-python/

choshin84 commented 5 years ago

Try out later https://github.com/pfnet/optuna

choshin84 commented 5 years ago

Annotation 2019-08-14 135823

choshin84 commented 5 years ago

Catboost needs to use GPU acceleration for some parameters, i.e. min_data_in_leaf