search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k stars 154 forks source link

The Dataset Names #417

Closed lixu6-alt closed 3 weeks ago

lixu6-alt commented 1 month ago

Hi,

Does anybody know where to find the dataset names that can be passed to the run.py? In the README, I am told to find the names in defined in vlmeval/utils/dataset_config.py, however, I couldn't find this configuration file in the given directory.

Thanks.

lixu6-alt commented 1 month ago

I have found the names in a table at the upper part of the README file.

FangXinyu-0913 commented 1 month ago

https://github.com/open-compass/VLMEvalKit/issues/402