About the MMMU performance

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.

240 stars 10 forks source link

About the MMMU performance #7

Open LIO-H-ZEN opened 3 months ago

LIO-H-ZEN commented 3 months ago

I conducted experiments on lllama3-8b. This repository can achieve comparable performance to lllama-next-llama3-8B on MME (1613 vs. 1603), but not on MMMU (37.4 vs. 41.7). Do you have any ideas?