open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.01k stars 142 forks source link

[Request] Consider integrating the following list? #257

Open sarapieri opened 2 months ago

sarapieri commented 2 months ago
kennymckormick commented 2 weeks ago

A-OKVQA has been supported now. We will add the rest ones into our TODO list.