utiasASRL / pyboreas

Devkit for the Boreas autonomous driving dataset.
BSD 3-Clause "New" or "Revised" License
90 stars 9 forks source link

Limit how often people can submit to the benchmark #38

Open keenan-burnett opened 1 year ago

keenan-burnett commented 1 year ago

We want to make it hard for people to overfit to the test set. One way to do this is to limit how many submissions each user can make per month, say 2 submissions per month. We may need an auxilliary authentication method to prevent users from creating multiple accounts to circumvent this.