bellymonster / Weighted-Soft-Label-Distillation

55 stars 8 forks source link

KD Loss keeps raising during training #9

Open BluebirdStory opened 2 years ago

BluebirdStory commented 2 years ago

hello, I am using WSLD on my own dataset, however, loss KD loss keeps increasing, is it normal? could you please provide a training log on cifar-100 or imagenet? so we can see a normal training performance of WSLD