search

egoschema / EgoSchema

61 stars 0 forks source link

How to identify the certificate length of a VQA？ #8

Closed GanJayjay closed 5 months ago

GanJayjay commented 6 months ago

Hello， Thanks for sharing this great work! I wonder how you measure the cetificate length of a VQA. In your paper, you filtered the dataset based on the certificate length and also measured the certificate length for other existed datasets. How do you achieve this? Is it a manual process? Or did you use LLM to measure it. If so, how do you achive it?

egoschema commented 5 months ago

Hello

We mainly used human labeling to label the certificate length but we limited the amount of human hours spent on each dataset. Human labelers had to answer what part of the video was minimally sufficient to answer the question. In a lot of cases for some datasets, even 1 sec is enough to find the answer.