search

hila-chefer / Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
MIT License
1.75k stars 232 forks source link

Extension to other huggingface transformer models? #54

Closed mollie9523 closed 1 year ago

mollie9523 commented 1 year ago

Hi,

I am interested to apply this transformer explainability to other huggingface transformer models such as Swin Transformer and CvT. How can I do so?

Thank you.

hila-chefer commented 1 year ago

Hi @cactusmomo, thanks for your interest! As of now, the models in this repo are the models we support, expanding to swin Transformers is an interesting and non trivial effort (see previous issues) if you come up with something for that- please share :)