koaning / tokenwiser

Bag of, not words, but tricks!
https://koaning.github.io/tokenwiser/
Apache License 2.0
68 stars 7 forks source link

Use Word Frequencies to Filter #51

Open koaning opened 3 years ago

koaning commented 3 years ago

It seems like a valid trick to only keep words that aren't mega frequent.

https://twitter.com/r_speer/status/1433550844725796868