关于两次前向传播

princeton-nlp / SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

MIT License

3.31k stars 502 forks source link

Closed noob-ctrl closed 3 months ago

noob-ctrl commented 4 months ago

您好，我看代码中好像只进行了一次前向传播，那么x和正样例采用的dropout不是一样的吗？那二者的输出结果不就一样了吗？

gaotianyu1350 commented 4 months ago

Hi,

Our model does two forward passes because the input is a pair of sentences in the unsupervised case (and the two sentences in the pair are the same).

github-actions[bot] commented 3 months ago

Stale issue message