mojavelinux
commented
8 years ago If you look in your browser console, you will likely see the following:
The character encoding of the plain text document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the file needs to be declared in the transfer protocol or file needs to use a byte order mark as an encoding signature.
I have yet to figure out why Firefox would use such a dumb default, and how to work around it. It is Firefox that is giving Asciidoctor garbled text, and admitting it. Why on earth do they not serve UTF-8 by default?
The plugin retrieves the raw text using:
document.firstChild.textContentIf you run this in the console, you can see the garbage that Firefox is giving us.
The plugin used to fallback to XmlHttpRequest to retrieve the text in UTF-8, automatically detecting the encoding error. However, that seems to have been removed in recent versions (perhaps because Mozilla rejected it).
https://github.com/asciidoctor/asciidoctor-firefox-addon/blob/master/data/asciidocify.js#L53
Here's what it used to do:
// if charset is not UTF-8, try techniques to coerce it to UTF-8
// likely used only for local files
if (document.characterSet.toUpperCase() != 'UTF-8') {
try {
// this technique works if all characters are in standard ASCII set
// see: http://www.ascii-code.com
sanitizeAndShowHTML(convertToHTML(decodeURIComponent(escape(document.firstChild.textContent))));
} catch (decodeError) {
// XMLHttpRequest responseText is UTF-8 encoded by default
var xhr = new XMLHttpRequest();
xhr.open('GET', window.location.href, true);
xhr.onload = function (evt) {
if (xhr.readyState === 4) {
// NOTE status is 0 for local files (i.e., file:// URIs)
if (xhr.status === 200 || xhr.status === 0) {
sanitizeAndShowHTML(convertToHTML(xhr.responseText));
} else {
console.error('Could not read AsciiDoc source. Reason: [' + xhr.status + '] ' + xhr.statusText);
}
}
};
xhr.onerror = function (evt) {
console.error(xhr.statusText);
};
xhr.send();
}
} else {
sanitizeAndShowHTML(convertToHTML(document.firstChild.textContent));
}I don't know any other way to force Firefox to give us UTF-8 encoded text.
minibiti
ggrossetie
getreu
ghost
Hi, I have German and Norwegian characters in my document which do not render properly when I use the extension. Is there some custom attribute I could use to turn UTF-8 support on, or it is just not supported at the moment?
Thanks! JM.