sul-dlss / dlme

Digital Library of the Middle East web application, based on Spotlight
https://dlmenetwork.org/
Other
19 stars 2 forks source link

Malformed CSV Error on Penn Near East #232

Closed aaron-collier closed 7 years ago

aaron-collier commented 7 years ago

2017-08-29T19:39:15-07:00 FATAL Traject::CommandLine: Unexpected exception, terminating execution: #<CSV::MalformedCSVError: Unquoted fields do not allow \r or \n (line 2).>

aaron-collier commented 7 years ago

It appears there are several (about 700 or so) lines with an extraneous \r at the end. When viewed in vi, they look like:

42594,Near Eastern,50-3-332,Flake,,,Iran|Belt Cave,Flint,,,,,"Seven Caves Expedition, Belt Cave Iran; Carleton S. Coon, 1950",,,,,,,,,,,,,,http://www.penn.museum/collections/object/42594^M

When these are removed, the error line changes.

aaron-collier commented 7 years ago

This will be addressed in: https://github.com/waynegraham/dlme-metadata/pull/12