Add MathVerse - Githubissues

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

https://lmms-lab.github.io/

Other

1.03k stars 53 forks source link

Add MathVerse #60

Closed CaraJ7 closed 2 months ago

CaraJ7 commented 2 months ago

Add the evaluation of MathVerse.

Luodian commented 2 months ago

Thanks for this PR! It's in a pretty good form, we will merge it soon. Btw, do you have a screenshot for evaluation results for a standard model (e.g. llava-v1.5-7b)~

CaraJ7 commented 2 months ago

Hi! I conduct the evaluation for llava-v1.5-7b. Here is the screenshots for the problem version of 'Vision Only' and 'Text Lite'.