search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.34k stars 188 forks source link

[Minor] Fix path problem in tools.py && Add log #422

Closed SYuan03 closed 2 months ago

SYuan03 commented 2 months ago
  1. fix "output" path problem in tools.py
  2. Add more logs making it possible to see which dataset is currently being run,
  3. Make it possible for multiple dataset runs to continue to the next dataset when one fails