search

oborchers / Fast_Sentence_Embeddings

Compute Sentence Embeddings Fast!
GNU General Public License v3.0
616 stars 83 forks source link

use normalized word vectors or not? #45

Closed shikharsingla closed 2 years ago

shikharsingla commented 3 years ago

Hi, I am using word2vec model to calculate sentence level embeddings and I was wondering if I should use normalized word vectors to train the SIF model?

oborchers commented 2 years ago

Hi @shikharsingla! Well, this may affect the result of the SVD to some degree. But testing this out is up to you.