Add support for fastspell for language identification

Helsinki-NLP / OpusFilter

OpusFilter - Parallel corpus processing toolkit

MIT License

101 stars 18 forks source link

Open marco-c opened 10 months ago

marco-c commented 10 months ago

It can help disambiguate between similar languages, see https://github.com/mbanon/fastspell.