ahmetaa / zemberek-nlp

NLP tools for Turkish.
Other
1.14k stars 207 forks source link

Introduce a new Token class instead of using Anltr dependent Token class. #179

Closed ahmetaa closed 5 years ago

ahmetaa commented 5 years ago

This will be a big breaking change. Brace for impact.

ahmetaa commented 5 years ago

Now there is zemberek.tokenization.Token