benathi / word2gm

Word to Gaussian Mixture Model
BSD 3-Clause "New" or "Revised" License
283 stars 73 forks source link

Can I train word2GM on very short expressions ? #4

Closed unvaiso closed 7 years ago

benathi commented 7 years ago

Can you elaborate on this? Do you mean training on a corpus which consists of only very short phrases/sentences? If that's what you mean, the answer is yes. Whether that would give high quality embeddings is not clear. I would assume that longer sentences give more contextual information and should yield better word embeddings quality.

unvaiso commented 7 years ago

Thank you, that's what I wanted to know.