The code is built on mdistiller.
Environments:
Install the package:
sudo pip3 install -r requirements.txt
sudo python3 setup.py develop
Download the cifar_teachers.tar
at https://github.com/megvii-research/mdistiller/releases/tag/checkpoints and untar it to ./download_ckpts
via tar xvf cifar_teachers.tar
.
python3 tools/train_ours.py --cfg configs/cifar100/ours/res32x4_res8x4.yaml
Download the dataset at https://image-net.org/ and put them to ./data/imagenet
python3 tools/train_ours.py --cfg configs/imagenet/r34_r18/kd_ours.yaml
Sincere gratitude to the contributors of mdistiller for your distinguished efforts.
Ying Jin: sherryying003@gmail.com