search

HobbitLong / RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
BSD 2-Clause "Simplified" License
2.17k stars 395 forks source link

the implementation of cckd is not consistent with the paper #15

Closed xiaojieli0903 closed 4 years ago

xiaojieli0903 commented 4 years ago

。

HobbitLong commented 4 years ago

The current version is what the authors sent me (except that I restructured a little to make it compatible with my running framework). They told me this version is almost as good as their full version on CIFAR, and I have no access to the full version. So I just used it.

xiaojieli0903 commented 4 years ago

Got it! Thank you for your answer!