Auomatic language detection of project homepages

Trilarion / opensourcegames

Technical infos of open source games.

https://trilarion.github.io/opensourcegames/

Creative Commons Zero v1.0 Universal

684 stars 85 forks source link

Auomatic language detection of project homepages #317

Open Trilarion opened 3 years ago

Trilarion commented 3 years ago

95% are in English, but some aren't. Can we detect the language automatically by some Python library and then mark them with our meta tags, like @lang:de?

algorithm:

download website
only keep text
detect language
store as tag if not english
maybe store english confirmed websites somewhere