search

open-compass / MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
Apache License 2.0
163 stars 10 forks source link

Evaluation server return 0 score #25

Closed czczup closed 9 months ago

czczup commented 9 months ago

Hello, there seems to be a problem with the evaluation server, both dev and test sets have returned 0 scores in the last few days.

image
LinB203 commented 9 months ago

same question. 5 days at least.

kennymckormick commented 9 months ago

Our evaluation service is temporarily down, please send your prediction files to opencompass@pjlab.org.cn instead.

Lin-Tianwei commented 9 months ago

@kennymckormick Hello, I have sent the prediction file to your email. Thank you very much for your help.

zodiacg commented 9 months ago

@Lin-Tianwei Hi, have you received your results? How long does it take to evaluate the results currently?

kennymckormick commented 9 months ago

Hi, all, the evaluation server has already been fixed now.