Cross modal KD implementation release?

HobbitLong / RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods

BSD 2-Clause "Simplified" License

2.17k stars 395 forks source link

Open liu115 opened 3 years ago

liu115 commented 3 years ago

Thank you for this great work! It's awesome.

I wonder will you release the implementation of cross-modal KD in the future? Thanks!

HobbitLong commented 2 years ago

Hi, I might not be able to clean and release that part, but it's exactly the same implementation (loss-wise).