Exact results number for Figure 3

BradyFU / Video-MME

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

395 stars 12 forks source link

Exact results number for Figure 3 #21

Closed Ziyang412 closed 2 months ago

Ziyang412 commented 3 months ago

Hi, thanks for open-sourcing the awesome work!

I saw in the paper and this repository the figure about "Evaluation results of different MLLMs across different task types". I think that is really interesting and would be a good detail evaluation for future models. I am wondering if you have the exact results number for all of these tasks for different split (short/medium/long) since it is hard to get the accurate number from the figure. It would be awesome if the authors could kindly provide these numbers and motivating future works. Thanks!

Any help would be highly appreciated!

BradyFU commented 2 months ago

Hi Ziyang, thanks for your attention on our work. Could you mind leaving your WeChat id? We could share the data with you.

Ziyang412 commented 2 months ago

Ziyang_412

Thanks

Chaoyou Fu @.***>于2024年8月6日周二上午4:05写道：

Hi Ziyang, thanks for your attention on our work. Could you mind leaving your WeChat id? We could share the data with you.

— Reply to this email directly, view it on GitHub https://github.com/BradyFU/Video-MME/issues/21#issuecomment-2271010355, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2YYYB4DFQCFPJYUWJGXBFLZQCUWNAVCNFSM6AAAAABL7EBEXWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENZRGAYTAMZVGU . You are receiving this because you authored the thread.Message ID: @.***>