GT-Vision-Lab / VQA

Other
363 stars 139 forks source link

Any other ways to get result accuracy on test205 since the server is closed ? #6

Closed daisysnow closed 6 years ago

daisysnow commented 6 years ago

Hi,@AishwaryaAgrawal I want to get accuracy for test2015, but the Challenge page told me the challenge is ended. But it worked yesterday. Is there any other ways for me to get the accuracy?

image

StanislawAntol commented 6 years ago

The "Challenge test2015" submissions were purely for the VQA challenge (as part of the CVPR workshop). The non-Challenge test2015 "Codalab phase" should still be open for submitting results to and getting back accuracies (e.g., to report in papers).

daisysnow commented 6 years ago

@StanislawAntol Thanks for your timely reply! But I did not find the "Codalab phase", could you give me a link ? It is really matters for me! Thanks very much!

daisysnow commented 6 years ago

@StanislawAntol
Sorry, I found that I was using the Codelab phase, but it said that it was closed, and I can not submit my result. Any ideas about that?

AishwaryaAgrawal commented 6 years ago

Hi @daisysnow,

The issue seems to be at Codalab's end. We are working with Codalab admins to resolve the issue.

We will let you know once the issue is resolved.

Best, Aishwarya

StanislawAntol commented 6 years ago

There are no direct links. But, as an example, for the open-ended real competition, you can go here and then click on "Real test2015 (oe)" and not "Real Challenge test2015 (oe)".

daisysnow commented 6 years ago

@AishwaryaAgrawal @StanislawAntol Thanks !

Hoping it can be resolved as soon as possible~