cdpierse / transformers-interpret

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Apache License 2.0
1.27k stars 96 forks source link

Support for Summarization models #129

Open jmdu99 opened 1 year ago

jmdu99 commented 1 year ago

Hi,

I would like to ask if this tool works with Seq2Seq models fine-tuned for summarization like BART or T5. Or if you plan to add this in the future. Thanks!

datalee commented 1 year ago

me too

Fidac commented 1 year ago

Me too plz! I already open an issue on Captum too. Thanks! Let me know if there is anything I can help we need this for a big project.

cdpierse commented 1 year ago

I'm looking into this at the moment, it's kind of a tricky one to reason around because Seq2Seq models process one token at a time so the explanations would need to be calculated for each generated token with each new addition to the sequence accounted for, I'll give it a look and see if it can be done.