An error in CCBench file

open-compass / MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"

Apache License 2.0

163 stars 10 forks source link

An error in CCBench file #20

Closed schuper closed 5 months ago

schuper commented 10 months ago

As shown above, the answers is CC. The above situation appears in CCBench which index is 319, 1000319, 2000319 and 3000319. I think it have not been paying attention.

kennymckormick commented 10 months ago

Thanks, @schuper , we will fix it in a later update.

kennymckormick commented 5 months ago

Hi, @schuper , the problem has been fixed, please adopt the latest VLMEvalKit for evaluation.