search

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.44k stars 124 forks source link

Bug: MVBench-video #298

Open orrzohar opened 1 week ago

orrzohar commented 1 week ago

Hi,

MVBench appears to be looking for videos that are not created: mvbench_video/star/Charades_segment/*.mp4

It appears that you are missing some code to split Charades into segments.

Best, Orr

kcz358 commented 5 days ago

Hi, current MVBench still has some issues on the caching file. The last fix from the PR #280 is not complete. I have contacted the author and they said they will try to fix this with a new version recently

kcz358 commented 2 days ago

Hi, I think this bug has been fixed in recent PR #306