Has anyone implemented Wasserstein Contrastive Representation Distillation

HobbitLong / RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods

BSD 2-Clause "Simplified" License

2.11k stars 389 forks source link

Has anyone implemented Wasserstein Contrastive Representation Distillation #42

Open Xinxinatg opened 2 years ago

Xinxinatg commented 2 years ago

I noticed that there is a paper titled "wasserstein contrastive representation distillation" lately which borrowed most of the idea from this RepDistiller while modifying the distance metric using wasserstein distance. While trying to implement the algorithm, I am wanting to see whether there are some code publicly available that I won't reinvent wheels. BTW I sent one email to the author of that paper yesterday, haven't got response yet.

AILMLHL commented 1 month ago

Hey brother, have you implemented the code? Can you send me a copy?