search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
996 stars 141 forks source link

Suspected error? #308

Closed Shijinghang closed 2 weeks ago

Shijinghang commented 1 month ago

image An error occurred while calculating the COCO Caption score, indicating the position in image_caption.py as shown in the figure. Is this a code error?

junming-yang commented 1 month ago

Hi, @Shijinghang. What error do you meet? I tried to reproduce it but failed (model: InternVL2-1B). Can you provide more information?

kennymckormick commented 2 weeks ago

Issue closes due to no response in a long time. Feel free to re-open it when needed.