lupantech / MathVista

MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts
https://mathvista.github.io/
Creative Commons Attribution Share Alike 4.0 International
226 stars 35 forks source link

How to apply for a leaderboard test #21

Closed zRzRzRzRzRzRzR closed 7 months ago

zRzRzRzRzRzRzR commented 7 months ago

In the code, I can complete the test of 1,000 local data on my own. I want to know, for the remaining 5,000 data, how should I submit to the leaderboard test to get the evaluation scores.

  1. Where to upload the model ( or just submit the json file is ok,not model infer code)
  2. Need Other resouce or just send a json file to email

Thanks

lupantech commented 7 months ago

I have updated the Readme file for more detailed instructions for contributing to the leaderboard. I highlight the updates below. Hope it is helpful to you!

The evaluation instructions are available at 🔮 Evaluations on MathVista and 📝 Evaluation Scripts of Our Models.

To submit your results to the leaderboard on the testmini subset, please send to this email with your result json file and score json file, referring to the template files below:

To submit your results to the leaderboard on the test subset, please send to this email with your result file (we will generate the score file for you), referring to the template file below: