CIFAR-10-Warehouse, consisting of 180 datasets collected by prompting image search engines (such as Google, Bing, Baidu, 360, Sogou, Pexels and Flickr) and diffusion models in various ways. Generally sized between 300 and 8,000 images, the datasets (domains) contain natural images, cartoons, certain colors, or objects that do not naturally appear.
You can access the dataset here.
A linux bash script can be used to download the datasets. It is provided by Adaloglou Nikolas 😊.
Directories & Files of images
CIFAR-10-W
├── data_360_cartoon_original/
│  ├── 360-CT-01/
│  │ ├── airplane/
│  │ │ ├── 0001.jpg
│  │ │ ├── 0002.jpg
│  │ │ ├── ...
│ │ ├── automobile/
│  │ │ ├── 0001.jpg
│  │ │ ├── 0002.jpg
│  │ │ ├── ...
│ │ └── ...
│  ├── 360-CT-02/
│  │ ├── airplane/
│  │ │ ├── 0001.jpg
│  │ │ ├── 0002.jpg
│  │ │ ├── ...
│ │ ├── automobile/
│  │ │ ├── 0001.jpg
│  │ │ ├── 0002.jpg
│  │ │ ├── ...
│ │ └── ...
│  └── ...
├── data_google_original/
│  └── ...
├── data_bing_original/
│  └── ...
├── ...
└── readme.txt
The AccP methods evaluated in our study are accessible here.
For domain generalization, we employed methods enumerated in DomainBed. It is important to note that datasets in CIFAR-10-W are only utilized as a test set.
Please cite this paper if it helps your research:
@inproceedings{sun2023privacy,
title={Cifar-10-warehouse: Broad and more realistic testbeds in model generalization analysis},
author={Sun, Xiaoxiao and Leng, Xingjian and Wang, Zijian and Yang, Yang and Huang, Zi and Zheng, Liang},
booktitle={ICLR},
year={2024}
}
We express gratitude to the great work Are Labels Always Necessary for Classifier Accuracy Evaluation? as we benefit a lot from both the paper and code.
This repository is released under the MIT license.