Closed Geek-lixiang closed 1 year ago
I have uploaded the loss function gkd_adaptive.py, and you can replace the vanilla kd loss with GKD loss. You may refer to TFace Github Link for a quick attempt.
I have uploaded the loss function gkd_adaptive.py, and you can replace the vanilla kd loss with GKD loss. You may refer to TFace Github Link for a quick attempt.