search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.34k stars 188 forks source link

infovqa_test测试时会报错 #469

Closed Cooperx521 closed 1 month ago

Cooperx521 commented 1 month ago

image

kennymckormick commented 1 month ago

Hi, @Cooperx521 , InfoVQA_TEST does not include gt answer, so you can not obtain the metrics of InfoVQA_TEST w. VLMEvalKit. You can evaluate the InfoVQA_val instead.