jiazhou-garland / EventBind

MIT License
19 stars 0 forks source link

About extract event #2

Open HyunsuYEE opened 1 month ago

HyunsuYEE commented 1 month ago

hello. it's wonderful works! in the paper, there is event retrieval by using the img or text query.

image

can you inform "how to retrieval the event from other modality query"? thank you.

jiazhou-garland commented 1 month ago

For image-to-event retrieval, obtain the image query embedding and all event embeddings, then calculate the similarity of all image-event pairs. Finally, take the Topk highest similarity scores as the Topk retrieved results.

jiazhou-garland commented 1 month ago

Please refer to the evaluate function in the train_dp_datasetname.py for code implementation.

HyunsuYEE commented 1 month ago

thank you for your answering. But, I want to know "how to visualize the events". can you share the code for visualize it?

jiazhou-garland commented 2 weeks ago

For the visualization of events, you may refer to the data loader part, where codes related to transforming event to event frames are released.