juanshishido / okcupid

Analyzing online self-presentation
MIT License
5 stars 0 forks source link

tokenizer #2

Closed matarhaller closed 8 years ago

matarhaller commented 8 years ago

There is a "Twitter-aware" tokenizer that we can try http://sentiment.christopherpotts.net/code-data/happyfuntokenizing.py