cdpierse / transformers-interpret

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Apache License 2.0
1.27k stars 96 forks source link

Using this for Music domain models #142

Open elloza opened 8 months ago

elloza commented 8 months ago

Congratulations on the work!

I was wondering if it would be possible to use this library as an explanation, but in the context of music. Let me explain:

If I use a tokeniser from the Miditok library: https://github.com/Natooz/MidiTok/blob/main/miditok/midi_tokenizer.py and a trained model like BertForSequenceClassification in that domain, could I use SequenceClassificationExplainer to give me an attribution for each of the tokens?

I understand that this is not prepared for this context and will give "token attributions". Am I right?

Is this feasible? Could you give me some advice on how to do this?

Thank you very much!