search

open-compass / MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
Apache License 2.0
163 stars 10 forks source link

Evaluation returns all zeros #21

Closed simplelifetime closed 10 months ago

simplelifetime commented 10 months ago

All the evaluation results return all zeros. Evaluation logs show 'CHATGPT api is not working'

nicedoctor commented 10 months ago

got the same problem

nbasyl commented 10 months ago

Same here, @kennymckormick could you please take a look? I checked the evaluation log, it said chatgpt api is not working which I assume is the problem here ?

kennymckormick commented 10 months ago

Hey guys @simplelifetime @nicedoctor @nbasyl , this issue has been solved now. Now the platform can successfully complete the evaluation.

Lin-Tianwei commented 9 months ago

从除夕夜到目前为止，我一直试图提交测试，然而返回的结果都是“ChatGPT API is not working”，请问是出了什么问题吗 @kennymckormick

kennymckormick commented 9 months ago

从除夕夜到目前为止，我一直试图提交测试，然而返回的结果都是“ChatGPT API is not working”，请问是出了什么问题吗 @kennymckormick

Hi, Tianwei, Our API service is experiencing failure and we may not be able to fix it during the new year holiday. As a temporary solution, you can send your prediction results to opencompass@pjlab.org.cn and we will help you with the evaluation.

Isaachhh commented 9 months ago

@kennymckormick I have sent my submissions to the email box and I sincerely request for your help. Thank you so so much!