search

ziyin-dl / word-embedding-dimensionality-selection

On the Dimensionality of Word Embedding
https://nips.cc/Conferences/2018/Schedule?showEvent=12567
MIT License
329 stars 44 forks source link

word2vec CBOW #21

Open ronhab opened 4 years ago

ronhab commented 4 years ago

Thanks for sharing the code!

Sorry if the question is silly - my understanding of word embeddings is still premature and lack the required math background: Should the SignalMatrix implementation for word2vec Skip Gram model fit for word2vec CBOW model?

ziyin-dl commented 4 years ago

theoretically they are still different models. However I do think they are not that different in practice. I think whatever hyperparameter (e.g. dimensionality) that works for skipgram will work for cbow too.