ropensci / tokenizers

Fast, Consistent Tokenization of Natural Language Text
https://docs.ropensci.org/tokenizers
Other
185 stars 25 forks source link

Add strip_numeric = TRUE option to tokenize_tweets() #79

Closed fschaffner closed 1 year ago

fschaffner commented 3 years ago

Could strip_numeric = be added as an option to tokenize_tweets()?

Currently tokenize_tweets("@rOpen5Sci and #rstats see: 10 https://cran.r-project.org", strip_numeric = TRUE) produces an error message.

lmullen commented 1 year ago

This function has been removed in the current version.