marcotcr / lime

Lime: Explaining the predictions of any machine learning classifier
BSD 2-Clause "Simplified" License
11.54k stars 1.8k forks source link

LIME Explanation showing positive values for Class 1 for any probability #658

Open hanzigs opened 2 years ago

hanzigs commented 2 years ago

Creating LIME explanations from a lgbm model, the model prediction gives Class 1 probability as 99.99% and LIME explanations shows all positive values, when the model prediction gives Class 1 probability as 0.01% then also LIME explanations showing all positive values, I am trying to understand that to explain

Model Prediction for Class 1 with 99.99% image

Model Prediction for Class 1 with 0.001% image

Model Prediction for Class 1 with 75.23% image

Model Prediction for Class 1 with 34.48% image

How to explain this interpretation of LIME? It gives explanation for Class 1, but how to explain the explanation values for 99% and 0.1% probability are positives?