tokenise with polyglot - Githubissues

Devadath / Malayalam-Shallow-Parser

This is a Shallow parser for Malayalam.

4 stars 2 forks source link

tokenise with polyglot #3

Closed enfageorge closed 1 year ago

enfageorge commented 4 years ago

The original tokenizer used indic-tokenizer is deprecated. Updated to polyglot.