Closed rhdunn closed 12 years ago
In addition to this work, the encoding APIs need improving:
set_encoding(int codepage)
to only call set_encoding(string encoding)
once;The encoding API work (with tests) is now in place.
This is done except for BOM handling.
The MIME headers (mhtml, email, http) can specify a character encoding. This should be adhered to when processing the internal data content (e.g. passed to the XML reader API).
Also, text documents can have a Byte-Order Mark that specifies what flavour of UTF encoding they are.
RTF documents handle their own encoding for escaped characters.
With text documents, it would be useful to specifically override/configure the default encoding (default as
utf-8
, override with e.g.cainteoir --encoding=latin-1
or as a preference/setting in cainteoir-gtk).