search

princeton-nlp / SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
MIT License
3.33k stars 505 forks source link

Changing Dropout Mask #201

Closed Baharkmi closed 1 year ago

Baharkmi commented 1 year ago

Hi,

I was wondering how I can change the dropout mask in the code.

gaotianyu1350 commented 1 year ago

Hi,

The dropout mask is randomly sampled by the Dropout layer. It is in the hidden states instead of over the input sequences.