datagovuk / dgu2

Experimental publishing prototype
MIT License
0 stars 1 forks source link

Run all incoming CSV data through iconv #126

Closed rossjones closed 8 years ago

rossjones commented 8 years ago

As a temporary fix to #125 now when we download a CSV for preview, we'll write it to disk, run it through iconv to convert to utf8 (assuming source is iso 8859 1 - which it normally is, thanks Excel) and then send that instead.

In future, we don't want to do this every time we fetch the CSV, we should cache the converted copy.