search

allenai / aokvqa

Official repository for the A-OKVQA dataset
Apache License 2.0
62 stars 7 forks source link

The prediction output file does not match the required format #12

Closed Taoismer closed 5 months ago

Taoismer commented 6 months ago

I used the code in the repo to genereate prediction_val.json for evaluation, but the generated format does not match the required format:

{ '' : { 'multiple_choice' : '', 'direct_answer' : '' } }

Is it a bug?

apoorvkh commented 5 months ago

You will need to provide more details before I am able to help you.

Specifically, which commands did you run? And what does your output look like, if not in the format above?

apoorvkh commented 5 months ago

Closing this issue for now, but please re-open if you are able to provide more details.