microsoft / factored-segmenter

Unsupervised factor-based text tokenizer for natural-language processing applications
17 stars 3 forks source link