Existing work: Language identification

rust-ml / nlp-discussion

15 stars 0 forks source link

Existing work: Language identification #10

Open danieldk opened 5 years ago

jbowles commented 5 years ago

Natural language detection for Rust with focus on simplicity and performance: whatlang-rs has been in development for 3 years; I've not used it but it looks solid.

danieldk commented 5 years ago

Indeed looks like a solid option that supports a lot of languages. Note though that the Cavnar & Trenkle has been succeeded by more modern and accurate techniques, see e.g.:

https://fasttext.cc/blog/2017/10/02/blog-post.html