search

NVlabs / DeepInversion

Official PyTorch implementation of Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion (CVPR 2020)
Other
479 stars 77 forks source link

What is the KD temperature in the CIFAR10 experiment #9

Open MingSun-Tse opened 3 years ago

MingSun-Tse commented 3 years ago

Hi, great thanks for your inspiring work! I am trying to reproduce the data-free KD experiment on CIFAR10. The descriptions in the paper and supplementary material help a lot, but I cannot find the temperature of KD you used. Could you help with this?

The code in the cifar10 directory can only generate one batch of data, there is no KD training there. If possible, could you complete the left training part? I am afraid unofficial implementations may not reproduce your results (as noted in other issues). Really appreciate it!

Regards,

pamolchanov commented 3 years ago

Hi, the temperature used was set to the default value of 3 and never changed. We will take into consideration the need to share details on KD training for Cifar10 and release it asap.

MingSun-Tse commented 3 years ago

Hi, the temperature used was set to the default value of 3 and never changed. We will take into consideration the need to share details on KD training for Cifar10 and release it asap.

Hi @pamolchanov , any updates about releasing the cifar10 training code?