search

google / inspiration_tree

Apache License 2.0
59 stars 10 forks source link

how about Contrastive Learning #27

Open yja1 opened 4 months ago

yja1 commented 4 months ago

how about add contrastive learning loss? example in Figure, vl looks like learning color and vr looks like learning shape. so , vl between color relative words as positive. others words coule as negative.

JackChen890311 commented 3 months ago

Same idea here, but I think the key is how to design the loss