search

DAMO-NLP-SG / VideoLLaMA2

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Apache License 2.0
871 stars 60 forks source link

How to eval egoschema and perception_test？ #50

Closed caichaoxiang closed 4 months ago

caichaoxiang commented 4 months ago

Hi,

After inference, I have obtained the output files of egochema and perception_test. However, these two datasets do not directly get the evaluation results like videomme. How can I evaluate the results later?

lixin4ever commented 4 months ago

To obtain the numbers on EgoSchema and Perception Test MCQA, you need to submit the model outputs to the official evaluation server. Here are the links of the evaluation servers:

LiangMeng89 commented 2 days ago

Hi,

After inference, I have obtained the output files of egochema and perception_test. However, these two datasets do not directly get the evaluation results like videomme. How can I evaluate the results later?

Hello,I'm a phD student from ZJU, I also use videollama2 to do my own research,we create a WeChat group to discuss some issues of videollama2 and help each other,could you join us? Please contact me: WeChat number == LiangMeng19357260600, phone number == +86 19357260600,e-mail == liangmeng89@zju.edu.cn.