search

baaivision / Emu

Emu Series: Generative Multimodal Models from BAAI
https://baaivision.github.io/emu2/
Apache License 2.0
1.66k stars 86 forks source link

Eval Dataset #41

Closed jybxie123 closed 10 months ago

jybxie123 commented 1 year ago

Hi, I have a question about the COCO dataset evaluation. What' s the meaning in the benchmark/COCO/annotations/vqa_test.json and vqa_val_eval.json? Or could you please give the link of these dependent datasets?

zhangxiaosong18 commented 1 year ago

They are VQAv2 annotation files processed by LAVIS and can be downloaded from https://storage.googleapis.com/sfr-vision-language-research/LAVIS/datasets/vqav2/vqa_val_eval.json and https://storage.googleapis.com/sfr-vision-language-research/LAVIS/datasets/vqav2/vqa_test.json