Parser is not correctly recognizing some character encodings

rcchen / cs210-stockholm

Repository for CS210: Stockholm Syndrome (Compuverde)

2 stars 2 forks source link

Closed rcchen closed 10 years ago

rcchen commented 10 years ago

eg. Eirini A?ndili

trumanc commented 10 years ago

Could you send me the file that isn't being parsed correctly?

rcchen commented 10 years ago

It's the Olympic Athlete one. Pick any Latin-speaking country and plot the table in the visualization creator, and you'll get some blank spaces.

trumanc commented 10 years ago

This issue was supressed previously, but has reappeared with Redis parsing. I'll look into forcing UTF-8 encoding at file-read time.

rcchen commented 10 years ago