mayubo2333 / MMLongBench-Doc

Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
https://huggingface.co/datasets/yubo2333/MMLongBench-Doc
Apache License 2.0
55 stars 1 forks source link

mismatched dataset stats #3

Open luyijian3 opened 1 month ago

luyijian3 commented 1 month ago

In the paper, it is stated that the number of image-as-evidence-source is 293, however, in the data/samples.json, there are 187 samples with image as the only evidence source and 304 that have image as one of the evidence sources. Is there anything I have missed that could explain this problem?

mayubo2333 commented 1 month ago

The correct number is 304.

Thank you for pointing out this wrong number, it should be a typo. I will fix it and upload an updated paper soon.