quickwit-oss / whichlang

A blazingly fast and lightweight language detection library for Rust
MIT License
357 stars 13 forks source link

WiP: Multiple language detection #15

Open kareglazie opened 1 year ago

kareglazie commented 1 year ago

Added a function detect_multiple_languages, which returns a vec of tuples (language, score), sorted by score.

I'm stuck at the point of how the final scores for the languages are obtained and how to get the probability value out of that scores? It would be great to receive some help on that.