dgrtwo / tidy-text-mining

Manuscript of the book "Tidy Text Mining with R" by Julia Silge and David Robinson
http://tidytextmining.com
Other
1.32k stars 805 forks source link

Add discussion of tokens/tokenizing #13

Closed juliasilge closed 7 years ago

juliasilge commented 7 years ago

As pointed out on Twitter, it's probably a good idea to be more explicit in Chapter 2 about what a token is and what we mean by tokenizing.