search

dankogai / p5-encode

Encode - character encodings (for Perl 5.8 or better)
https://metacpan.org/release/Encode
37 stars 51 forks source link

Noncharacters should be allowed #156

Open Grinnz opened 3 years ago

Grinnz commented 3 years ago

According to Corrigendum #9, noncharacters (the values U+nFFFE and U+nFFFF (where n is from 0 to 10^16) and the values U+FDD0..U+FDEF) are permanently reserved but should be allowed in interchange.

These codepoints currently are not successfully encoded or decoded - by default, they are replaced by replacement characters (at least for UTF-8).

Grinnz commented 3 years ago

Related: https://github.com/chansen/p5-unicode-utf8/issues/7

Leont commented 2 years ago

Probably, this behavior should be an option, regardless of what's the default