open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
744 stars 85 forks source link

Support Blink Dataset #171

Closed Ezra-Yu closed 5 days ago

Ezra-Yu commented 3 months ago

一个更加关注 感知能力的数据集 Blink,非常纯粹的视觉感知benchmark。

https://zeyofu.github.io/blink/

image

可以看出,GPT4V与人类水平有比较大的差距

kennymckormick commented 2 months ago

Hi, @Ezra-Yu , thanks for your suggestion and we will have a review on this dataset.

junming-yang commented 5 days ago

VLMEvalkit has supported BLINK.