AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
310 stars 11 forks source link

any plan to release the original images for SEED-Bench-2-Plus? #25

Open hjeun opened 5 months ago

hjeun commented 5 months ago

Hello, I just read the paper SEED-Bench-2-Plus and downloaded it from huggingface. But all images in the dataset are resized to 800x800. Will you release original images that preserves the aspect ratio?

Bohao-Lee commented 4 months ago

Thank you for your attention on our work. In human annotation process of SEED-Bench-2-Plus, we just use the 800 * 800 images to annotate. Hence, we won't provide original images.