christophM / interpretable-ml-book

Book about interpretable machine learning
https://christophm.github.io/interpretable-ml-book/
Other
4.76k stars 1.06k forks source link

Naive Bayes is a linear model #314

Closed JEHoctor closed 2 years ago

JEHoctor commented 2 years ago

In the summary table in the intro to chapter 5, Naive Bayes is marked as a non-linear model. From my superficial research his seems to be false in some important cases, though it may be true in some others. Here are some reference materials collected via search engine:

The most basic argument here is that Naive Bayes takes a product of probabilities, and this can be converted to a sum using a logarithm. Does this mean that Naive Bayes is compatible with explanation techniques for linear models? Does the logarithm interfere with this?

christophM commented 2 years ago

That's correct. The same is true for logistic regression. I added two sentences to clarify this to the table. Thanks for raising this!