search

thammegowda / mtdata

A tool that locates, downloads, and extracts machine translation corpora
https://pypi.org/project/mtdata/
Apache License 2.0
147 stars 22 forks source link

Force utf-8 encoding (be explicit) #71

Closed thammegowda closed 3 years ago

thammegowda commented 3 years ago

https://github.com/thammegowda/mtdata/blob/8cc7f5ba034e6d30eceb9ab37437f4ba0104368e/mtdata/index/elrc_share.py#L10

This line fails on places where utf-8 is not default, eg.. windows terminal dont have utf-8 as default.

Temporary work around (to enable utf-8 in windows terminal): https://akr.am/blog/posts/using-utf-8-in-the-windows-terminal