Fix #285 ValueError when using TweetTokenizer

sloria / TextBlob

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

https://textblob.readthedocs.io/

MIT License

9.08k stars 1.13k forks source link

Fix #285 ValueError when using TweetTokenizer #325

Closed jschnurr closed 4 months ago

jschnurr commented 4 years ago

When specifying your own tokenizer, TextBlob expects a base class of nltk.tokenize.api.TokenizerI. While nltk.tokenize.TweetTokenizer provides the required interface, it does not meet that requirement. Added explicitly as a valid option, along with related tests.