search

christophM / interpretable-ml-book

Book about interpretable machine learning
https://christophm.github.io/interpretable-ml-book/
Other
4.8k stars 1.06k forks source link

8.5 Permutation Feature Importance #351

Open alexhallam opened 2 years ago

alexhallam commented 2 years ago

Great book.

One comment I would add.

I think that another disadvantage of permutation feature importance is directionality. In some applications it is not enough to know how important a feature is, but if that feature moved the response up or down. To my knowledge permutation feature importance does not provide directionality.

christophM commented 2 years ago

Thanks for the feedback. I currently see feature importance as something for ranking features.

Directionality is something I consider that feature effects or feature attributions have.

alexhallam commented 2 years ago

I agree. I am just making the point that "directionality" is not listed as a disadvantage of permutation feature importance. Maybe it does not need to be. I just wanted to say that the book does not point this out explicitly.

christophM commented 2 years ago

Yeah, I see now what you mean. Maybe I'll add that in the 3rd edition of the book.