search

dvlab-research / ReviewKD

Distilling Knowledge via Knowledge Review, CVPR 2021
248 stars 34 forks source link

Can we find the teacher_weights somewhere? #8

Closed Luodian closed 3 years ago

Luodian commented 3 years ago

When I run your scripts "reviewKD.sh" and "baseline.sh" in Cifar100. There's FileNotFoundError: 

FileNotFoundError: [Errno 2] No such file or directory: 'checkpoints/cifar100_wrn-40-2__baseline1_best.pt'
Namespace(T=4.0, batch_size=128, ce_loss_weight=1.0, dataset='cifar100', epochs=240, gamma=0.1, kd_loss_weight=5.0, kd_warm_up=20.0, kl_loss_weight=1.0, lr=0.1, lr_adjust_step=[150, 180, 210], model='wrn-40-1', resume='', seed=148, suffix='reviewkd1', teacher='wrn-40-2', teacher_weight='checkpoints/cifar100_wrn-40-2__baseline1_best.pt', test=False, use_kl=False, wd=0.0005)

Where could I find those weights or can you release the related teacher weights so that we can download and better configure our experiment environment.

akuxcw commented 3 years ago

Hi, we didn't provide pretrained teachers for cifar-100 now. Because it's easy and fast to train a teacher by yourself. You can train the wrn-40-2 teacher using this command. If you find any problem to train the teacher. We will consider uploading the teacher weights.

Luodian commented 3 years ago

Thanks!