open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k stars 154 forks source link

mme-realworld-score #456

Closed yfzhang114 closed 2 weeks ago

yfzhang114 commented 2 weeks ago
  1. adjust the scoring function of MME-RealWorld
  2. adapt the choice formating in csv file