search

eccv22-ood-workshop / ROBIN-dataset

ECCV 2022 Workshop: A Benchmark for Robustness to Individual Nuisances in Real-World Out-of-Distribution Shifts
http://www.ood-cv.org/
46 stars 6 forks source link

Some labels are duplicates #18

Open jam-cc opened 2 years ago

jam-cc commented 2 years ago

Some rows of "iid.csv" are duplicates, such as line 3 and line 7, which confused submissions. image

DTennant commented 2 years ago

Hi,

Sorry for the confusion, this is a mistake. Please make sure that the submitted files have the same order of entries as the sample submissions on codalab, including the duplicates, so that the evaluation script can still work.