Closed Tilana closed 7 years ago
with the split() method punctuation is not separated from words, 'e.g. ['this', 'is', 'an', 'example!']. Check out nltk libraries for a better tokenization.
use word_tokenize from nltk
with the split() method punctuation is not separated from words, 'e.g. ['this', 'is', 'an', 'example!']. Check out nltk libraries for a better tokenization.