search

OpenGVLab / MMT-Bench

ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
95 stars 3 forks source link

minicpm-v-llama3-2.5 suport? #6

Open zxxmxd opened 6 months ago

zxxmxd commented 6 months ago

I tested the minicpm-v-llama3-2.5 model while keeping all the parameters the same as minicpm-v-2.0, but it's worse than minicpm-v-2.0.

KainingYing commented 5 months ago

Thanks for your attention on MMT-Bench.

I speculate that the degradation in performance could be a result of the different training data.

Sorry for the late reply.