search

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.02k stars 52 forks source link

Q-Bench, Q-Bench2, A-Bench #113

Closed teowu closed 1 week ago

teowu commented 1 week ago

Support Q-Bench, Q-Bench2, A-Bench.

It is now working on Phi3v, Idefics2 smoothly, the result is aligned.

We also revise the logic of image placeholders in Phi3V, so that it can support multiple images.