Update documented split sizes for compatibility with 0.0.4

openphilanthropy / unrestricted-adversarial-examples

Contest Proposal and infrastructure for the Unrestricted Adversarial Examples Challenge

Apache License 2.0

327 stars 62 forks source link

Update documented split sizes for compatibility with 0.0.4 #73

Open juesato opened 5 years ago

juesato commented 5 years ago

Related question: the leaderboard says defenses will be evaluated on 1000 images. Is this based on an earlier version of the dataset, using the 1000 image test set, or is this a separate hold-out set?

juesato commented 5 years ago

(I think the failing Travis builds are a Python 3.5 issue and are not related to this PR, since this only updates the README.)

juesato commented 5 years ago

@nottombrown Do you know if an earlier version of the dataset had 40K images in the extras split? I've checked 0.0.3 and 0.0.2 (the first public version), and they both have 25K or 27.5K images in extras.