theodi / comma-chameleon

A desktop CSV editor for data publishers
https://comma-chameleon.io/
MIT License
280 stars 27 forks source link

Doesn't display foreign characters #81

Open davidread opened 9 years ago

davidread commented 9 years ago

Doesn't display foreign characters. e.g. Chinese https://github.com/okfn/messytables/blob/master/horror/characters.csv

You could also try other difficult CSVs from this dir: https://github.com/okfn/messytables/tree/master/horror

chris48s commented 7 years ago

This particular file does not import cleanly because it is not utf-8 encoded (I think its Big5 or windows-950?). From a UI perspective, manually specifying an alternative encoding to open with probably sits with issue #122. From a practical perspective, node's File IO module only supports a fairly limited set of encodings:

so implementing support for a wider range of character sets than that probably also requires use of an addtional library to add support for additional encodings.