facebookresearch / EgoVLPv2

Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]
MIT License
85 stars 11 forks source link

Is there preprocessing code for VQA dataset? #16

Open Songinpyo opened 4 months ago

Songinpyo commented 4 months ago

To use EgoVLPv2 (specifically EgoTaskQA) on custom VQA dataset, it is essential to preprocess the metadata about questions ans answers.

Specifically the "answer_encode" is needed. How can I encode other datasets to EgotaskQA form.

Have you used the official EgoTaskQA's preprocess code?

ShramanPramanick commented 4 months ago

Hi @Songinpyo, Thanks for your query and sorry for the late response. We followed the step-by-step data pre-processing steps as described in the EgoTaskQA repository: https://github.com/Buzz-Beater/EgoTaskQA/tree/main/baselines#preprocessing