problems about zero_evaluation

OpenGVLab / unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

https://arxiv.org/abs/2303.16058

MIT License

267 stars 13 forks source link

problems about zero_evaluation #41

Open Karine-Huang opened 1 month ago

Karine-Huang commented 1 month ago

Hello, Thanks for your great work! We'd like to run zero-shot evaluation on msrvtt qa task. However, following the readme below (set zero-shot evaluation and prepare dataset), we still encounter the problem (such as "No such file or directory", etc.)

Are there any other places we need to modify?

Thanks for your reply in advance!

Andy1621 commented 1 month ago

Hi! I have updated the code with multi_txt_gt. What about the bug for No such file or directory? Could you please provide the full log~

Andy1621 commented 1 month ago

For annotation files, check here.

Karine-Huang commented 1 month ago

Thanks for your reply~ We have downloaded annotation files, here is the bug:

Do we need to download all the training data when we just want to use zero-shot evaluation, or just Video-Text Retrieval and Video Question Answering of MSRVTT videos?

Thanks