christophM / interpretable-ml-book

Book about interpretable machine learning
https://christophm.github.io/interpretable-ml-book/
Other
4.75k stars 1.06k forks source link

Little fix in ALE #157

Closed fbetteo closed 3 years ago

fbetteo commented 4 years ago

In 5.3.3 the interpretation of ALE says: "The value of the ALE can be interpreted as the main effect of the feature at a certain value compared to the average prediction of the data. For example, an ALE estimate of -2 at xj=3 means that when the j-th feature has value 3, then the prediction is lower by 2 compared to the average prediction.."

Shouldn't it be "compared to the average change in prediction" ?

Also I think it is not completely clear why it is desirable to accumulate or why it is done. Any further clarification I think would be nice.

Tremendous work and great read! Keep it going!

xiaochi-liu commented 4 years ago

Hi there. I also have a little question about Accumulated Local effects (ALE) in 5.3.3:

image

I was wondering, how the effect was centered? What does "n" stand for? the number of instances in a specific interval? in an accumulated interval? or across all intervals in the feature j?

In other words:

ALE plots are centered at zero. This makes their interpretation nice, because the value at each point of the ALE curve is the difference to the mean prediction.

What is the mean prediction? Could you please explain it more detailed?

Thank you so much. I like this book.

christophM commented 3 years ago

The interpretation of ALE is not so straightforward, so both my current version is not perfect, but also it's not "compared to the average change in prediction".