do8572 / MLDS

MLDS course code.
0 stars 0 forks source link

Claim 3.3 makes it easier to interpret model interactions #13

Open do8572 opened 1 year ago

do8572 commented 1 year ago

Fig 7 investigates the SHAP values for an RF trained on the breast-cancer dataset. After applying HS, the SHAP values for each feature have tighter clusters. Each cluster comprises a group of samples for which the feature contributes a similar amount to the predicted response, and hence can be interpreted without taking into account feature interactions, thereby reducing cognitive burden. More globally, the clustering effect suggests that HS improves prediction performance by regularizing some unnecessary interactions in the model, making the fitted function closer to being additive. Appendix S5.2 shows the SHAP plots for all 8 classification datasets, showing that HS consistently leads to more clustered SHAP values.

dmohorcic commented 1 year ago

...can be interpreted without taking into account feature interactions...

This makes no sense. HS acts as a regularization, so removing feature interaction from interpretations sounds completely wrong.