uidaholib / base-digital-collections-template

A highly customized version of CollectionBuilder-CSV used to generate University of Idaho Library Digital Collections.
MIT License
0 stars 0 forks source link

corrupt character check #13

Closed evanwill closed 8 months ago

evanwill commented 8 months ago

check every CSV for corrupt character , replace, rebuild if necessary:

evanwill commented 8 months ago

corrupted metadata will look something like:

tabor1004,pg83-b02-f15-018_010,pg83-b02-f15-018_010,02,Cleo Bardelli,,"Photo of a portrait of Cleo Bardelli, who was crowned the Queen of Wallace, Idaho���������s Silver Jubilee. She is looking over her shoulder. This photo was used in the promotion of the city���������s 75th Jubilee celebration during the summer of 1958. Cleo was the daughter of Guido & Mary Bardelli of Osburn, ID.  Guido, also known as ���������Young Firpo��������� and the ���������Wild Bull of Burke���������, who was a famed Pacific Northwest championship boxer from Burke, Idaho, in the 1920���������s and 1930���������s.  Guido ���������Firpo��������� Bardelli was inducted into the World Boxing Hall of Fame in 2008. ",1958,1958,,women; pageants; portraits,,,,,"PG 83, George W. Tabor Photographs, 1890-1963",Image;StillImage,Black & white negative,George W. Tabor Photographs,https://archiveswest.orbiscascade.org/ark:80444/xv538451,University of Idaho Library Special Collections and Archives,eng,"In copyright, educational use permitted. Educational use includes non-commercial reproduction of text and images in materials for teaching and research purposes. For other contexts beyond fair use, including digital reproduction, please contact the University of Idaho Library Special Collections and Archives Department at [libspec@uidaho.edu](mailto:libspec@uidaho.edu). The University of Idaho Library is not liable for any violations of the law by users.",http://rightsstatements.org/vocab/InC-EDU/1.0/,image/jpeg,image,https://objects.lib.uidaho.edu/tabor/pg83-b02-f15-018_010.jpg,http://objects.lib.uidaho.edu/tabor/small/pg83-b02-f15-018_010_sm.jpg,https://objects.lib.uidaho.edu/tabor/thumbs/pg83-b02-f15-018_010_th.jpg,,

The set of � represent a single corrupted character and need to be replaced. e.g. Idaho���������s Silver Jubilee. is Idaho's Silver Jubilee.

Be careful with quoting inside of CVSs! Quotes in values that are inside quotes need to be double quoted. In the example above,

"Photo of a portrait of Cleo Bardelli, who was crowned the Queen of Wallace, Idaho's Silver Jubilee. She is looking over her shoulder. This photo was used in the promotion of the city's 75th Jubilee celebration during the summer of 1958. Cleo was the daughter of Guido & Mary Bardelli of Osburn, ID.  Guido, also known as ""Young Firpo"" and the ""Wild Bull of Burke"", who was a famed Pacific Northwest championship boxer from Burke, Idaho, in the 1920's and 1930's.  Guido ""Firpo"" Bardelli was inducted into the World Boxing Hall of Fame in 2008. ",

examples: