What about the gqa-ood testdev details?

gqa-ood / GQA-OOD

GQA-OOD is a new dataset and benchmark for the evaluation of VQA models in OOD (out of distribution) settings.

26 stars 1 forks source link

What about the gqa-ood testdev details? #4

Closed alice-cool closed 2 years ago

alice-cool commented 2 years ago

Dear scholar, I don't get the details about your gqa-ood testdev results. I think it can be from two circumstance, 1), we trained the model in gqa balanced train sets and validation sets, then tested on gqa-ood testdevsets. 2), we trained the model in gqa balanced train sets and gqa ood-valid sets , then tested on gqa-ood testdevses. And I think the two circumstance is all plausible. Which one is from your paper?

gqa-ood commented 2 years ago

Dear @alice-cool,

In the paper, we did:

Training: GQA balanced training set
Validation: GQA-OOD validation set
Test: GQA-OOD validation set

Corentin K.