search

bellymonster / Weighted-Soft-Label-Distillation

55 stars 8 forks source link

Hyper-parameters settings？ #8

Open David-19940718 opened 2 years ago

David-19940718 commented 2 years ago

Hi, thank u for your nice job! Can you give me advice about how to set hyper-param of temperature coefficient and loss weight?

David-19940718 commented 2 years ago

Another question, the teacher network should be pre-trained on a custom dataset first?