search

LSYS / LexicalRichness

:smile_cat: :speech_balloon: A module to compute textual lexical richness (aka lexical diversity).
http://lexicalrichness.readthedocs.io/
MIT License
96 stars 19 forks source link

Disallow string input when tokenizer is set to None #12

Closed LSYS closed 2 years ago

LSYS commented 3 years ago

For custom NLP pipelines, disallow string input when tokenizer is set to None.

Assert that input is a list of words instead of a string.