whwu95 / Cap4Video

【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
https://arxiv.org/abs/2301.00184
MIT License
225 stars 16 forks source link

Which part of the code is the interaction module implemented in? #14

Closed shams2023 closed 9 months ago

shams2023 commented 10 months ago

I didn't see where the video-caption interaction was actually implemented

whwu95 commented 9 months ago

Please refer https://github.com/whwu95/Cap4Video/blob/62e62b0daa17a4bac1efb585b6ce200db9d52a6f/modules/modeling_tv_titles_video.py#L211C9-L211C50