haitongli / knowledge-distillation-pytorch

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
MIT License
1.84k stars 342 forks source link

regression problem can use this method? #8

Closed door5719 closed 5 years ago

door5719 commented 6 years ago

hi,i want to know whether Knowledge Distillation can be used in regression problem

haitongli commented 6 years ago

Some regression problems can be turned into classification problems, but I'm not sure how to do it with distillation. Won't hurt to explore a bit and try :)

door5719 commented 6 years ago

Thank you~