search

youqingxiaozhua / APViT

PaddlePaddle and PyTorch implementation of APViT and TransFER
Apache License 2.0
38 stars 9 forks source link

Attention visualization #3

Closed swordLJP closed 1 year ago

swordLJP commented 1 year ago

I want to get attention visualization of different expressions like whitch shown in your paper Transfer, can you provide some tools? I am new to Paddle. It's a bit difficult to convert the code from pytorch to paddle.

youqingxiaozhua commented 1 year ago

As we cited in the paper, we used this tool to visualize the attention maps. If you use pytorch for model training, it may not be necessary to convert it to paddle. Their APIs are very similar, and our implementation follows the original ViT codes as in timm.