search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
276 stars 8 forks source link

Ask for original captions from which you generate questions #4

Closed YangYangGirl closed 11 months ago

YangYangGirl commented 11 months ago

Congrats on the excellent work. Can you release the original captions from which you generate questions? It will be helpful to the community.

geyuying commented 11 months ago

Thank you for your interest in our work. We find that the orignial captions from various vision foundation models can be noisy (that's why we use human annotation), so we may not release the original captions of this version.