search

GlobalDataverseCommunityConsortium / dataverse-previewers

A collection of Datafile Previewers that can be configured to work with Dataverse
MIT License
13 stars 38 forks source link

Previewer not displaying special characters in text-based files #35

Open jggautier opened 4 years ago

jggautier commented 4 years ago

Just reporting that are not being displayed in files text files, like CSV files and .txt files, like this one at https://doi.org/10.7910/DVN/YZRJWD/A0SND4:

Screen Shot 2020-01-17 at 2 13 46 PM

@djbrooke tried to see if this might be a known issue with one of the previewer's dependencies but didn't find anything, I think.

qqmyers commented 4 years ago

Looks like the code retrieves the file as binary and doesn't set the encoding (UTF-8?). It looks like the underlying library used can retrieve the file directly from the URL and may handle that. If not, it may be something we need to set in the call. @anncie-pcss - are you able to look at fixing this somehow?