marcotcr / lime

Lime: Explaining the predictions of any machine learning classifier
BSD 2-Clause "Simplified" License
11.5k stars 1.79k forks source link

Why top_labels predicted by LIME sometimes differ from the one predicted by the model? #592

Closed evapachetti closed 3 years ago

evapachetti commented 3 years ago

I've always made the explain based on the top label found by LIME, but i found that sometimes it is different by the one predicted by my model. In this case, what should i do? Should i let LIME doing prediction for the label he found or should i do it for the label actually predicted by my model? I tried the second option but obviouslly it is counterintuitive, indeed it generates red super pixels in the hot spot of my image even if the label predicted by the model was the right one.

Thank you