search

ModelOriented / localModel

LIME-like explanations with interpretable features based on Ceteris Paribus curves. Now on CRAN.
https://modeloriented.github.io/localModel
14 stars 3 forks source link

individual_surrogate_model returns counterintuitive results #35

Closed pbiecek closed 3 years ago

pbiecek commented 5 years ago

For titanic dataset the random forest model shall increase probability of survival for young passangers.

But this explainer predicts negative influence of young age

library("DALEX")
library("randomForest")

titanic <- archivist::aread("pbiecek/models/27e5c")
titanic_rf_v6 <- archivist::aread("pbiecek/models/31570")
johny_d <- archivist::aread("pbiecek/models/e3596")

library("localModel")
localModel_lok <- individual_surrogate_model(explain_rf_v6, johny_d,
                                        size = 5000, seed = 1313)

plot(localModel_lok)

It is not consistent with ceteris paribus features (which confirm that young age increases survival)

plot_interpretable_feature(localModel_lok, "age")