search

frabcus / judgmental

UK case law
http://judgmental.org.uk/
16 stars 4 forks source link

Deal with really badly encoded files #8

Closed chris321 closed 13 years ago

chris321 commented 13 years ago

Although we've gone to some length to deal with character encoding problems, some files simply declare their character encoding incorrectly and/or are not encoded with an encoding known to humans.

chris321 commented 13 years ago

Done - we now replace invalid bytes with the unicode replacement character.