Open sartaki opened 1 month ago
Hi! In the latest version, we follow Unmasked Teacher to conduct the evaluation. Please check the code and meta data~
For Q1, we use 1k subset for testing. For Q2, only one caption for each video.
Thanks @Andy1621. Will look at the link you pointed and get back to you if I have any doubts. Thanks.
Thanks for the paper and the open sourcing the code base.
I would like to know how evaluation is performed on the MSR-VTT dataset for zero shot text to video retrieval.
video7960
isa band performing in a small club
butvideo8978
fits the same profile. Another caption for the same videovideo7960
isa group of boys and girls are dancing
butvideo9957
also can be considered correct if retrieved. I will be happy to provide more such examples.Looking forward for your clarification. Thanks!