Regarding results in the paper

facebookresearch / InferSent

InferSent sentence embeddings

Other

2.28k stars 471 forks source link

Regarding results in the paper #61

Closed Viresh-R closed 6 years ago

Viresh-R commented 6 years ago

Hey guys, Does the model which gets 84.5 on SNLI test set use dropout(in the encoder and fc layers)? If so, what's the dropout rate ? Also, did you guys experiment with fc layers with more neurons than 512 ? Does it help ?

And thanks so much for sharing the code !

aconneau commented 6 years ago

Hi, dropout didn't help much in our case no. The default setting uses a number of hidden units that was found to work best on validation data. Best, Alexis