JigenDG

Repository for the CVPR19 oral paper "Domain Generalization by Solving Jigsaw Puzzles". To cite, please use:

@inproceedings{carlucci2019domain,
  title={Domain Generalization by Solving Jigsaw Puzzles},
  author={Carlucci, Fabio Maria and D'Innocente, Antonio and Bucci, Silvia and Caputo, Barbara and Tommasi, Tatiana},
  booktitle={CVPR},
  year={2019}
}

SETUP

Pytorch models will automatically download if needed. You can download the caffemodel we used for AlexNet from here https://drive.google.com/file/d/1wUJTH1Joq2KAgrUDeKJghP1Wf7Q9w4z-/view?usp=sharing

Once downloaded, move it into models/pretrained/alexnet_caffe.pth.tar

Once you have download the data for the different experiments, you must update the files in data/txt_list to match the actual location of your files. For example, if you saved your data into /home/user/data/images/ you have to change these lines:

/home/fmc/data/PACS/kfold/art_painting/dog/pic_001.jpg 0
/home/fmc/data/PACS/kfold/art_painting/dog/pic_002.jpg 0
/home/fmc/data/PACS/kfold/art_painting/dog/pic_003.jpg 0

into:

/home/user/data/images/PACS/kfold/art_painting/dog/pic_001.jpg 0
/home/user/data/images/PACS/kfold/art_painting/dog/pic_002.jpg 0
/home/user/data/images/PACS/kfold/art_painting/dog/pic_003.jpg 0

A quick way is to use sed: for i in *.txt; do sed -i "s@/home/fmc/data/@/home/user/data/images/@g" $i; done

Running experiments

Run run_PACS_photo.sh to run the DG experiment on PACS, with photo as target (using AlexNet).

Note that when using ResNet you should set the image_size to 222 An example on how to get ResNet18 results on PACS, art_painting as target:

python train_jigsaw.py --batch_size 128 --n_classes 7 --learning_rate 0.001 --network resnet18 --val_size 0.1 --folder_name test --jigsaw_n_classes 30 --train_all True --TTA False --nesterov False --min_scale 0.8 --max_scale 1.0 --random_horiz_flip 0.5 --jitter 0.4 --tile_random_grayscale 0.1 --source photo cartoon sketch --target art_painting --jig_weight 0.7 --bias_whole_image 0.9 --image_size 222

VLCS

Some people are having issues accessing the VLCS dataset; I have uploaded a copy here: http://www.mediafire.com/file/7yv132lgn1v267r/vlcs.tar.gz/file