Empty strings in the dev annotations

JUNJIE99 / MLVU

🔥🔥MLVU: Multi-task Long Video Understanding Benchmark

132 stars 0 forks source link

Empty strings in the dev annotations #3

Open Becomebright opened 1 week ago

Becomebright commented 1 week ago

Hi,

I've noticed some empty strings in the dev annotations. For instance, in 7_topic_reasoning.json:

{
    "video": "movie101_89.mp4",
    "duration": 677,
    "question": "",
    "candidates": [
        "",
        "",
        "",
        ""
    ],
    "answer": "",
    "question_type": "topic_reasoning"
}

Could you please confirm if these are annotation errors? Thanks!

JUNJIE99 commented 5 days ago

We have corrected and updated the relevant annotations.

Thank you for pointing out the oversight.