how to do attention visualization?

[oldDriver69]

I refer to the online attention visualization tutorial on vit, but it can't achieve the effect in your paper. Can you share the code of the visualization part? Thank you very much

[heshuting555]

Hi, We refer to the following code base for the visualization code in the paper. https://github.com/jacobgil/vit-explain https://github.com/jeonsworld/ViT-pytorch/blob/main/visualize_attention_map.ipynb

Hope the answer is helpful.

[realjoshqsun]

Hi, We refer to the following code base for the visualization code in the paper. https://github.com/jacobgil/vit-explain https://github.com/jeonsworld/ViT-pytorch/blob/main/visualize_attention_map.ipynb

Hope the answer is helpful.

Hi,

These two methods are transformer-specified. However, Grad-CAM that is mentioned in your paper is not transformer-specified, and it can be worked with different structures to the best of my knowledge.

[ww5171351]

你好， 论文中的可视化代码我们参考下面的代码库。 https://github.com/jacobgil/vit-explain https://github.com/jeonsworld/ViT-pytorch/blob/main/visualize_attention_map.ipynb

希望答案是有帮助的。

你好，对于这个可视化，我还是遇到些问题。能否留个联系方式，想请教一下。我的qq563679292.非常感谢