作者您真的成功把CTKD应用到DKD上了吗

zhengli97 / CTKD

[AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"

https://zhengli97.github.io/CTKD/

Apache License 2.0

156 stars 12 forks source link

Closed ufestkc closed 11 months ago

ufestkc commented 11 months ago

DKDloss只要一backward就把所有值都变成了nan...

zhengli97 commented 11 months ago

README的model zoo里面已经提供了详细的log供参考

zhengli97 commented 11 months ago

你成功跑起来了吗？在readme里面能找到我跑dkd的ctkd方法的训练log。如果没有问题的话，我就关闭这个issue了哈。如果还有问题，可以继续发邮件到我的邮箱 zhengli97[at]mail.nankai.edu.cn