Question about the test json of msvd and msrvtt dataset

mbzuai-oryx / Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

https://mbzuai-oryx.github.io/Video-ChatGPT

Creative Commons Attribution 4.0 International

1.05k stars 92 forks source link

Question about the test json of msvd and msrvtt dataset #113

Closed butemp closed 1 week ago

butemp commented 1 week ago

I have a small question, in this link you provide the relevant test set, but msvd and msrvtt are both val_Qa.json, is the experimental result of this work on test_qa or val_qa

mmaaz60 commented 1 week ago

Hi @butemp

Thank you for your interest in our work. We use val sets for MSVD and MSRVTT. Thanks.