marcotcr / lime

Lime: Explaining the predictions of any machine learning classifier
BSD 2-Clause "Simplified" License
11.42k stars 1.79k forks source link

LIME with object detection models #614

Closed emamangiapia closed 3 years ago

emamangiapia commented 3 years ago

Hi, is it possible to use LIME (or Anchors) with object detection models? Such as: faster RCNN, Yolo etc. If yes, which modifications should be done?

marcotcr commented 3 years ago

If you have a continuous or categorical function to explain, e.g. 'the probability that the object is in the image', you can just use LimeTabularExplainer as is (you'd just have to wrap the output of the object detection model so that it produces this output). If you are thinking of explaining the boundaries themselves, I don't know how I'd go about doing that.