search

megvii-research / mdistiller

The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.thecvf.com/content/ICCV2023/papers/Zhao_DOT_A_Distillation-Oriented_Trainer_ICCV_2023_paper.pdf
808 stars 123 forks source link

what are the values about alpha beta and T for resnet50-mobilenetv2? #49

Open ufestkc opened 1 year ago

ufestkc commented 1 year ago

are they 1.0 2.0 and 4.0 respectively? could u provide and thanks and are they the same across all experiments?

Zzzzz1 commented 1 year ago

They are 1.0 8.0 and 4.0 for CIFAR-100. You could find it in the supplement at https://arxiv.org/pdf/2203.08679.pdf