kinow
commented
7 years ago - Morgan Wahl Text is More Complicated Than You Think Comparing and Sorting Unicode PyCon 2017
- TODO: test [text] to check if our methods are OK with some examples in this talk)
- TODO: Canonical Decomposition, and code points comparisons; are we doing it? Are we doing it right?
- Do we have casefolding?
- Do we have multi-level sort?
- CLDR
- Łukasz Langa Unicode what is the big deal PyCon 2017
- Quite sure we have an issue to guess the encoding for a text.... there is a GPL library for that? Under Mozilla perhaps?
- Jiaqi Liu Fuzzy Search Algorithms How and When to Use Them PyCon 2017
- Does OpenNLP have N-GRAM's? Would it make sense to have that in [text]?
- Where can we find more tokenizers?
- Lothaire's Books