search

princeton-nlp / SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
MIT License
3.36k stars 507 forks source link

I'm curious about the meaning of "hard negative" in the thesis. #154

Closed fspanda closed 2 years ago

fspanda commented 2 years ago

I read the thesis very interestingly.

I have a question for you. Are you saying that the meaning of hard negative used in the thesis is "clearly negative" or is it used to mean "indistinguishable negative"?

Generally, it is used in the second sense, but after reading the thesis, I think you used it in the first sense.

gaotianyu1350 commented 2 years ago

Hi,

Here it is just clear negative. But compared to the in-batch negatives, it is more "indistinguishable".

fspanda commented 2 years ago

Thank you for answer :)