No annotations for test set

[DarthGalm]

Test sets don't have annotations to build a "ground truth", would it be possible to have them to evaluate how our model is performing?

[DeekshaArya]

Hi, you may evaluate your model using the leaderboards on our Big data Cup website. For further details, you may refer to the summary paper.

[DarthGalm]

Hello @DeekshaArya and thank you for your reply. What I intended is that test1 and test2 dataset do not have annotations like train dataset does. Since it's not possible anymore to submit our work and be evaluated, I'd like to know if you could release annotations for those as well, to evaluate ourselves and compare to the leaderboard. Kind regards.

[DeekshaArya]

Hi @DarthGalm.

The new submissions for test1 and test2 leaderboards for GRDDC have been disabled but you may still utilize the newly created test1-2 and test2-2 leaderboards for evaluating your predictions on test1 and test2. You may create an account and submit your prediction outputs for both the test datasets.

The following video may be helpful for further details.

[norper]

Hello @DeekshaArya The race is over. why did you just release annotations? I think hi want to test locally.

[fpiemontese]

I also would be interested in the annotations for the test sets. Thank you in advance.

[linchunmian]

Hi, what does the test1-2 and test2-2 mean?

[ver0z]

I'm interested to know if there will be available the annotations for test1 and test2