cuhksz-nlp / R2Gen

169 stars 50 forks source link

predict images and visual attention #18

Open Jcek opened 2 years ago

Jcek commented 2 years ago

Dear author: Thank you for sharing your training code. I am also interested in the Visualizations of image-text attention mapping part in the paper,and testing new images.Have you cleaned the code?

Sigma153 commented 2 years ago

Dear author: Thank you for sharing your training code. Is the effect diagram shown in your paper the weight of ATT in the memory layer? I can't find the att attention map for each word