Testdev set - Githubissues

gqa-ood / GQA-OOD

GQA-OOD is a new dataset and benchmark for the evaluation of VQA models in OOD (out of distribution) settings.

26 stars 1 forks source link

Testdev set #6

Open chojw opened 2 years ago

chojw commented 2 years ago

Hi,

I saw in one of your replies that you used the GQA-OOD validation set for Testing, does this mean that the ood_testdev was not used at all??

Thanks in advance!

I referenced the issue below:

Dear @alice-cool,

In the paper, we did:

Training: GQA balanced training set
Validation: GQA-OOD validation set
Test: GQA-OOD validation set

Corentin K.

Originally posted by @gqa-ood in https://github.com/gqa-ood/GQA-OOD/issues/4#issuecomment-984491135