american-art / npg

National Portrait Gallery
Creative Commons Zero v1.0 Universal
1 stars 6 forks source link

NPGConThesTerms: Bad character encodings in thesaurus terms #62

Open cbutcosk opened 7 years ago

cbutcosk commented 7 years ago

In the source CSV data, thesis terms with special characters in their labels (e.g place names "zürich," "düsseldorf," "românia") have unicode replacement symbols in place of special characters, "z�rich", "d�sseldorf", "rom�nia". This character is then carried through to thesaurus labels and URIs: http://data.americanartcollaborative.org/npg/thesuari/place_of_birth/d�sseldorf, http://data.americanartcollaborative.org/npg/thesuari/place_of_birth/z�rich, http://data.americanartcollaborative.org/npg/thesuari/place_of_birth/rom�nia, etc.