search

cerlymarco / linear-tree

A python library to build Model Trees with Linear Models at the leaves.
MIT License
338 stars 54 forks source link

Reference #9

Closed YorgosMoiragias closed 2 years ago

YorgosMoiragias commented 2 years ago

Hi,

I really like your work with Linear Trees, I would like to ask if there are references in some kind of papers, which describe accurately in the form of equations the split procedure!!

Thank you in advance, George Moiragias

cerlymarco commented 2 years ago

Hi, thanks for your feedback

As a base reference you can consider these works:

Ross J. Quinlan: Learning with Continuous Classes. In: 5th Australian Joint Conference on Artificial Intelligence, Singapore, 343-348, 1992.

Y. Wang, I. H. Witten: Induction of model trees for predicting continuous classes. In: Poster papers of the 9th European Conference on Machine Learning, 1997.

However, the way linear trees are developed here is simpler than expected. The logic of splitting is based simply on evaluating the loss of candidate children after fitting linear models on the splits. If you know how decision trees work it is straightforward to adopt the same concept to linear trees. The core function to evaluate the splits in my code is present here

Thanks