Helsinki-NLP / OpusFilter

OpusFilter - Parallel corpus processing toolkit
MIT License
102 stars 18 forks source link

Add lingua-py support for language identification #65

Closed marco-c closed 10 months ago

svirpioj commented 10 months ago

Thanks, looks quite good. As lingua doesn't support Python 3.7 (or at least tells so), we'll need to drop it also from OpusFilter. I didn't plan to do that yet, but since it's reached the end-of-life last year it's anyway inevitable soon.

For some reason, the automatic checks did not run here, and I couldn't start them myself either. A created a new PR so I could make the Python version changes and run the tests. I'll close this one and continue on that.