winkjs / wink-nlp-utils

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.
http://winkjs.org/wink-nlp-utils/
MIT License
119 stars 12 forks source link

Improve ngram - bigram function #15

Closed giorgio79 closed 5 years ago

giorgio79 commented 6 years ago

The ngram is for string, while the bigram is for tokens. Wondered if tokens could have a more generic ngram function where you can feed in the maximum gram as a parameter?

http://winkjs.org/wink-nlp-utils/#tokensbigrams

So we could have sg like this https://github.com/nlp-compromise/nlp-ngram

rachnachakraborty commented 6 years ago

Hi @giorgio79,

This feature is in our roadmap.

Best, Rachna