search

lupantech / MathVista

MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts
https://mathvista.github.io/
Creative Commons Attribution Share Alike 4.0 International
197 stars 28 forks source link

GPT4V output file #9

Closed TobiasLee closed 5 months ago

TobiasLee commented 5 months ago

Thanks for your great work!

I'm currently working on computing multiple-choice accuracy scores for a subset of the testmini set. I've found the corresponding output file for output_llava_llama_2_13b.json under MathVista/results/llava/, but it seems to be missing in the gpt4v repository.

Could you please provide the missing multiple-choice accuracy output file for gpt4v for accurate comparisons?

Thanks in advance!

TobiasLee commented 5 months ago

@lupantech

lupantech commented 5 months ago

Hi @TobiasLee,

Thank you for your interest in MathVista! To assist you further with your request for the multiple-choice accuracy output file for gpt4v, could you please send the request to this email? We appreciate your effort in making accurate comparisons.

Thank you!

Best regards, Pan