search

ageron / handson-ml2

A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.
Apache License 2.0
28.07k stars 12.8k forks source link

[QUESTION] Why Gradient Boost only uses Decision Trees #579

Open Kirushikesh opened 2 years ago

Kirushikesh commented 2 years ago

I wonder after reading Chapter 7 that in Ada Boost Ensemble Algorithm multiple types of base learning algorithms can be used ex: decision trees, svm, logistic regression, etc. But in the implementation of Gradient Boosting algorithm in sklearn the weak learners are fixed to be type decision trees, why don't it give freedom and equal rights to other algorithms. There may be a reason to do so that's my question anyway why?

ageron commented 2 years ago

Thanks for your question. I'm currently traveling for the next few weeks, but I'll try to answer when I get back.