How to get attention visualizations for AVT?

facebookresearch / AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"

Apache License 2.0

152 stars 28 forks source link

How to get attention visualizations for AVT? #46

Open vineetparikh opened 1 year ago

vineetparikh commented 1 year ago

Hi there, thanks so much for the interesting work!

I'm a bit confused on how to reproduce the precise attention map visualizations in the AVT paper, showing which frames attend strongly to which other frames in AVT-h. Is there any code available for reproducing those visualizations?

Thanks in advance for your help! Vineet