search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
315 stars 12 forks source link

any plan to release the original images for SEED-Bench-2-Plus? #25

Open hjeun opened 6 months ago

hjeun commented 6 months ago

Hello, I just read the paper SEED-Bench-2-Plus and downloaded it from huggingface. But all images in the dataset are resized to 800x800. Will you release original images that preserves the aspect ratio?

Bohao-Lee commented 6 months ago

Thank you for your attention on our work. In human annotation process of SEED-Bench-2-Plus, we just use the 800 * 800 images to annotate. Hence, we won't provide original images.