princeton-nlp / SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
MIT License
3.33k stars 505 forks source link

Got a Better Result? #204

Closed 2hip3ng closed 1 year ago

2hip3ng commented 1 year ago

I reproduced the experiment based on bert-base-uncased. And I didnot change any parameter. The result is image The paper is image

The experiment is done on GPU V100 * 4. It seems to imporve a lot.

gaotianyu1350 commented 1 year ago

Hi,

I believe you are looking at the DEV set. Our README has instructions on evaluating on the test set. Though the results could still vary based on different hardware and random seeds.

2hip3ng commented 1 year ago

Hi, it's Dev set. Thanks~