how to get the attention or heat map of swin-transformer?

Beckschen / TransMix

[CVPR 2022] This repository includes the official project for the paper: TransMix: Attend to Mix for Vision Transformers.

Apache License 2.0

157 stars 12 forks source link

how to get the attention or heat map of swin-transformer? #5

Closed choresefree closed 2 years ago

choresefree commented 2 years ago

hello, authors! Recently, I have been interested in swin-transformer. However, the heat map I got is very unreasonable. I see that you had worked on swin-transformer, so I want to know your ways of drawing heat map or attention map of swin-transformer. I would be grateful if you could give me the answer.

Beckschen commented 2 years ago

Hello,

Thanks for your interests. Please refer to Section 4.5 of the paper, which details how we generalized TransMix to SwinTransformer.