mihaela-stoian / ROAD-R-2023-Challenge

Other
16 stars 2 forks source link

Could you release the metric code for Task 1 and 2? #5

Closed foolhard closed 1 year ago

foolhard commented 1 year ago

Hi,

Could you release the metric code for Tasks 1 and 2? It's convenient for us to test the val set locally.

Thanks.

EGiunchiglia commented 1 year ago

Unfortunately, that is not possible as we need to limit the number of times participants are able to evaluate their models both on the validation and test set.

Lavreniuk commented 1 year ago

hi, @foolhard , have you been able to reproduce the baseline results for task2?

EGiunchiglia commented 1 year ago

@Lavreniuk I guess all problems were solved with the new post-processing method. I will thus close the this issue.

foolhard commented 1 year ago

Yes, I can submit the results to the leaderboard correctly with the new post-processing code. Thanks for your kindly support.