search

haofanwang / natural-language-joint-query-search

Search photos on Unsplash based on OpenAI's CLIP model, support search with joint image+text queries and attention visualization.
208 stars 20 forks source link

Some questions about visualization #3

Open Mark-Dou opened 2 years ago

Mark-Dou commented 2 years ago

Hello, thanks for sharing your excellent work to us ! I have some questions about attention visualization that the code was executed to visualize attention on text, if I' d like to get a heat map just like Gard-CAM for visualizing image, could you give me some advice?

haofanwang commented 2 years ago

Hi, @Mark-Dou , sorry for my late reply. This project may give you some insights.