fnl / segtok

Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic features.
http://fnl.es/segtok-a-segmentation-and-tokenization-library.html
MIT License
170 stars 22 forks source link

Kmike py2 with stdio encoding fix #3

Closed fnl closed 9 years ago

fnl commented 9 years ago

Updated PR #2 with my fix for the Unicode stdout problem included.