search

GT-Vision-Lab / VQA

Other
359 stars 138 forks source link

Error in the provided Fake results json file #13

Closed tejan-rgb closed 2 years ago

tejan-rgb commented 2 years ago

Hi @deshraj @dexter1691 @jiasenlu @StanislawAntol @jwyang @AishwaryaAgrawal,

The Fake Results JSON file provided has only 248349 entries for the train2014 images, while the total number of questions for train2014 images is 443757. Hence, an error is coming up while calculating the accuracy on the Fake Results JSON file. Please do check it.

Thanks.

AishwaryaAgrawal commented 2 years ago

That file corresponds to VQA v1 not v2.

Best, Aishwarya

On Wed, 17 Aug 2022, 13:35 Tejan Mehndiratta, @.***> wrote:

Hi @deshraj https://github.com/deshraj @dexter1691 https://github.com/dexter1691 @jiasenlu https://github.com/jiasenlu @StanislawAntol https://github.com/StanislawAntol @jwyang https://github.com/jwyang,

The Fake Results JSON file provided has only 248349 entries for the train2014 images, while the total number of questions for train2014 images is 443757. Hence, an error is coming up while calculating the accuracy on the Fake Results JSON file. Please do check it.

Thanks.

— Reply to this email directly, view it on GitHub https://github.com/GT-Vision-Lab/VQA/issues/13, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADA4SXMHEUGBVP7JO5DTE43VZUPG5ANCNFSM562LRDTQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

tejan-rgb commented 2 years ago

Ok, thanks.

Thanks Tejan Mehndiratta

On Fri, 19 Aug, 2022, 03:31 Aishwarya Agrawal, @.***> wrote:

That file corresponds to VQA v1 not v2.

Best, Aishwarya

On Wed, 17 Aug 2022, 13:35 Tejan Mehndiratta, @.***> wrote:

Hi @deshraj https://github.com/deshraj @dexter1691 https://github.com/dexter1691 @jiasenlu https://github.com/jiasenlu @StanislawAntol https://github.com/StanislawAntol @jwyang https://github.com/jwyang,

The Fake Results JSON file provided has only 248349 entries for the train2014 images, while the total number of questions for train2014 images is 443757. Hence, an error is coming up while calculating the accuracy on the Fake Results JSON file. Please do check it.

Thanks.

— Reply to this email directly, view it on GitHub https://github.com/GT-Vision-Lab/VQA/issues/13, or unsubscribe < https://github.com/notifications/unsubscribe-auth/ADA4SXMHEUGBVP7JO5DTE43VZUPG5ANCNFSM562LRDTQ

. You are receiving this because you are subscribed to this thread.Message ID: @.***>

— Reply to this email directly, view it on GitHub https://github.com/GT-Vision-Lab/VQA/issues/13#issuecomment-1220014714, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATIHQXDV4YAAX3VR54F53VLVZ2XD7ANCNFSM562LRDTQ . You are receiving this because you authored the thread.Message ID: @.***>