benathi / word2gm

Word to Gaussian Mixture Model
BSD 3-Clause "New" or "Revised" License
283 stars 73 forks source link

Number of negative samples = 1: for efficiency? #12

Open b05102139 opened 11 months ago

b05102139 commented 11 months ago

Hi Ben,

Thank you for the open source code, it has been very helpful! One question however: I was wondering why in both the current paper and the prob-fast-text paper, the number of negative samples is hardcoded to 1? Was it due to efficiency reasons, or is there reason to believe this is optimal for the current model? Thank you!