open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k stars 154 forks source link

There is no answer field in DocVQA_TEST #405

Closed palewithout closed 1 month ago

palewithout commented 1 month ago

There is no answer field in DocVQA_TEST. How can I get the answer field?

FangXinyu-0913 commented 1 month ago

DocVQA is a challenge raised by researchers, and you can find the details at https://rrc.cvc.uab.es/?ch=17&com=introduction. The answer to DocVQA_TEST is not public because this challenge remains. You can submit your results on this page to get your final results.