sl-93 SUPERVISED-CONTRASTIVE-LEARNING-FOR-PRE-TRAINED-LANGUAGE-MODEL-FINE-TUNING issues - Githubissues

sl-93 / SUPERVISED-CONTRASTIVE-LEARNING-FOR-PRE-TRAINED-LANGUAGE-MODEL-FINE-TUNING

in this project, I've implemented the Facebook paper about fine tuning RoBERTa with contrastive loss.

56 stars 5 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Can gradients in CL-loss “contrastive_loss(tem, hiden_state.cpu().detach().numpy(), b_labels)” be updated？

#2 zhaishengfang opened 2 years ago
2
there may be bugs

#1 enjlife opened 2 years ago
6