EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.03k stars 53 forks source link

Multilingual LLava bench #56

Closed gagan3012 closed 1 month ago

gagan3012 commented 2 months ago

This is the task to run multilingual llava bench from MBZUAI

Luodian commented 2 months ago

Thanks for this PR, it's clean since it's only adding files in tasks folder.

May I ask that if you could also give a screenshot to see a standard model (e.g. llava-v1.5-7b) results on multilingual-llava-bench?