search

martinmamql / relative_predictive_coding

Project page for paper Self-supervised Representation Learning with Relative Predictive Coding
MIT License
17 stars 1 forks source link

WPC loss ? #2

Closed AILMLHL closed 3 weeks ago

AILMLHL commented 3 weeks ago

There is no WPC loss-related code here. May I ask when it will be open-sourced?

martinmamql commented 3 weeks ago

Hi AILMLHL,

I apologize for the oversight -- unfortunately I am not able to recover WPC implementation right now, but feel free to implement WPC based on one of the losses (NWJ, JS or DV) and apply the gradient_penalty in https://github.com/martinmamql/relative_predictive_coding/blob/main/vision/objective.py#L36 to enforce Lipschitz continuity on the positive and negative scores.