cr0hn / golismero-legacy

THIS IS A LEGACY VERSION PRESERVED FOR BACKUP, DO NOT USE
http://golismero-project.com
15 stars 4 forks source link

Unicode strings and encoding problems #225

Open MarioVilas opened 10 years ago

MarioVilas commented 10 years ago

On Windows I keep getting encoding problems (weird symbols instead of the correct letters) when JSON data is re-encoded into UTF-8. I tried a simple solution (decoding UTF-8 and re-encoding into Latin-1 at Console._display) but it didn't work, so more effort is needed.

One possible solution is to start using Unicode strings everywhere. This is basically what Python 3 did. Printing Unicode directly to the console seems to be working well for Python 2.7 so this could be a viable option - plus both JSON and SQLite already use Unicode strings.