search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
315 stars 12 forks source link

Ask for original captions from which you generate questions #4

Closed YangYangGirl closed 1 year ago

YangYangGirl commented 1 year ago

Congrats on the excellent work. Can you release the original captions from which you generate questions? It will be helpful to the community.

geyuying commented 1 year ago

Thank you for your interest in our work. We find that the orignial captions from various vision foundation models can be noisy (that's why we use human annotation), so we may not release the original captions of this version.