search

OpenGVLab / MMT-Bench

ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
72 stars 2 forks source link

minicpm-v-llama3-2.5 suport? #6

Open zxxmxd opened 1 month ago

zxxmxd commented 1 month ago

I tested the minicpm-v-llama3-2.5 model while keeping all the parameters the same as minicpm-v-2.0, but it's worse than minicpm-v-2.0.

KainingYing commented 4 weeks ago

Thanks for your attention on MMT-Bench.

I speculate that the degradation in performance could be a result of the different training data.

Sorry for the late reply.