search

FORCOLAB-UofT / INFOX

This is a prototype for overview of GitHub forks.
http://www.forks-insight.com
MIT License
23 stars 16 forks source link

calculating tfidf for 2-grams #94

Open shuiblue opened 6 years ago

shuiblue commented 6 years ago

image by merging 1-gram and 2-gram, the 2nd 'key' would be removed

luyaor commented 6 years ago

I want to know the reason to remove the 'key' in this case or how to merging 1-gram and 2-gram. And what's the 2-gram you mean? I think we don't need to take consider the phrase which there is a space between two words.

If there is the case is like AbCd or ab.cd Which result you think is better? AbCd Ab, Cd