search

ynysjtu / ood_bench

47 stars 8 forks source link

Some images are in both the train and test split of NICO dataset? #3

Closed lihaoxin05 closed 2 years ago

lihaoxin05 commented 2 years ago

Hi. Thank you for the great work. However, I found that some images in the NICO dataset appear in both the provided train and test split. For example, truck\on_grass\34.jpg are in both datasets/NICO/mixed_split/env_test.csv and datasets/NICO/mixed_split/env_train1.csv. Could you please check if there is any error in the provided splits of NICO dataset? Or is that how it should be? Thanks.

m-Just commented 2 years ago

Thank you for pointing this out! It turns out there's a bug in the split generating code for NICO. Please refrain from using the split files provided under "mixed_split". The correct one is now under "mixed_split_corrected". Corresponding experiment results will be updated to our paper later.

lihaoxin05 commented 2 years ago

Thanks for your reply.