EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.02k stars 52 forks source link

add multi-lingual MMMU tasks #92

Closed Junpliu closed 1 month ago

Junpliu commented 1 month ago

mmmu_Arabic mmmu_English mmmu_French mmmu_Hindi mmmu_Indonesian mmmu_Japanese mmmu_Portuguese mmmu_Yoruba