amir-zeldes / RFTokenizer

A character-wise tokenizer for morphologically rich languages
Other
27 stars 7 forks source link