search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
310 stars 11 forks source link

Data source for "Transit Maps" model: not listed in this repository? also not listed on Huggingface? #29

Open miku2000 opened 3 months ago

miku2000 commented 3 months ago

If I interpret the https://arxiv.org/pdf/2404.16790 paper correctly, you have used transit maps for evaluation. However, I can't figure out which maps have been used: neither from the GitHub repo, nor from HuggingFace: https://huggingface.co/datasets/AILab-CVC/SEED-Bench-2

Could you please add this information? Or point me to existing listings, if I missed those?

Thanks! miku2000

Bohao-Lee commented 3 months ago

Thank you for your attention on our work. The paper you mentioned is SEED-Bench-2-plus not SEED-Bench-2. Here is corresponing dataset for SEED-Bench-2-plus.

Best Bohao Li