open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.21k stars 172 forks source link

测试Video-MME_CN #543

Open jun0yayay opened 2 hours ago

jun0yayay commented 2 hours ago

测试Video-MME_CN是否可行? 有建议怎么修改代码吗?比如是不是要把prompt改了

感谢!

FangXinyu-0913 commented 1 hour ago

Hi @jun0yayay, 想问一下您指的是哪个数据集呢,Video-MME好像暂未有cn版本