html preview with other char sets?

GlobalDataverseCommunityConsortium / dataverse-previewers

A collection of Datafile Previewers that can be configured to work with Dataverse

MIT License

13 stars 39 forks source link

html preview with other char sets? #7

Open qqmyers opened 5 years ago

qqmyers commented 5 years ago

QDR has an example where cyrillic doesn't display. Not sure yet whether this is a limitation of the previewer or not. Will investigate.

qqmyers commented 5 years ago

Looks like our example source html correctly displays, so it it something the previewer is doing - probably in sanitizing the html...

qqmyers commented 5 years ago

Or not - it appears that our example file is encoded as charset:windows-1251 rather than UTF-8. While it might be possible to detect the charset and convert (for any/all charsets), it may be easier to convert the files to start...

adam3smith commented 5 years ago

yeah, we don't need to fix issues with mis-encoded HTML files.