paip-2019 / challenge

30 stars 10 forks source link

whether the organizers can release the ground truth of the validation dataset? #45

Open chuxiang93 opened 5 years ago

chuxiang93 commented 5 years ago

Dear PAIP organizers, The validation dataset competition has ended. It can be seen from the leaderboard that there are several cases that almost all teams have not predicted, and the dataset also shows that these cases are very different from the distribution of training datasets. I wonder whether the organizers can release the ground truth of the validation dataset, so that we have the opportunity to continue to explore the problem. Thanks,

wisepaip commented 5 years ago

Thank you for the suggestion. We plan to open the validation ground truth after the test deadline. We will let you know when the data is updated.

Thank you.

yangsenwxy commented 4 years ago

I wonder when the organizers can release the ground truth of the test dataset.

wisepaip commented 4 years ago

Hello, the validation ground truth has been released on our website. Since we re-open the submission on the challenge website, we don’t have a plan to open the ground truth for the test set right now. Thank you.

yangsenwxy commented 4 years ago

Hi,can you share the validation ground truth link?

wisepaip commented 4 years ago

@yangsenwxy You could find the ground truth of validation at PAIP 2019 challenge data download website. Quick remind you that you could access PAIP 2019 and PAIP 2020 datasets with the same password. However, your previous password would be renewed when you got the recent credentials email.

yangsenwxy commented 4 years ago

@wisepaip I have sent an email, can you reply me?