pytorch / captum

Model interpretability and understanding for PyTorch
https://captum.ai
BSD 3-Clause "New" or "Revised" License
4.76k stars 481 forks source link

Add IBA to captum #358

Open berleon opened 4 years ago

berleon commented 4 years ago

Hi everyone,

first I want to thank you for this library! It is great to have a place with the most commonly used interpretability methods. We have developed an attribution method that can quantify the importance of areas in bits / pixel. Here is the paper and the reviews: https://openreview.net/forum?id=S1xWh1rYwB It was accepted for ICLR 2020.

We developed an easy-to-use library for pytorch (& tensorflow): https://github.com/BioroboticsLab/IBA

We think it would be a great addition to the many methods already included in captum. If you are interested in including our method, I could offer to integrate our pytorch code into captum.

Best, Leon

cc my co-author: @karl-schulz

NarineK commented 4 years ago

Thank you very much for the kind feedback. We definitely would love to support the community and are planning to start with an awesome list where people can add their algorithms. Apart from awesome list the next step would be to add an implementation to the contrib package which we will make ready for contributors and as a last step once the algorithms get more popularity we can graduate it and move to the core.

As a starting point we can start from adding it to the awesome list. Then we will review the approach and suggest to add it to contrib package if you agree :)

cc: @caraya10

berleon commented 4 years ago

yes, adding it to a awesome list would be good first step. Let me know if I can be of any help with the review or with adding it to the contrib package.