Closed JeffreyYStewart closed 1 year ago
tokenizer.ngrams_from_doc will not include tokens marked as stopwords in the ngrams it produces.
tokenizer.ngrams_from_doc now accepts any argument that can be passed to textacy.extract.basics.ngrams. This allows the user to choose whether stop words (or other features) will be included.
tokenizer.ngrams_from_doc
textacy.extract.basics.ngrams
tokenizer.ngrams_from_doc will not include tokens marked as stopwords in the ngrams it produces.