search

HobbitLong / RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
BSD 2-Clause "Simplified" License
2.12k stars 391 forks source link

Regression task #8

Closed xjcvip007 closed 4 years ago

xjcvip007 commented 4 years ago

Thank you for your sharing! In your paper, it seems that CRD method is suitable for classification task, does it compatible with regression task?

HobbitLong commented 4 years ago

Hi, @xjcvip007

Thank you for your thoughtful question! I did not try.

But my initial guess is that it would be compatible. Because our method is essentially representation learning. Wherever representation learning works, it might also work as well.