opendata / Open-Data-Needs

An ongoing effort to catalog the holes in the open data ecosystem. [RETIRED]
15 stars 0 forks source link

Invalid CSV files #7

Open dwillis opened 9 years ago

dwillis commented 9 years ago

Here's an example: the FEC is producing candidate and committee summary files (available here) that can contain interior double-quotes. Excel handles these just fine, but most programming language CSV parsers do not.

waldoj commented 9 years ago

Per suggestions made at the SRCCON discussion that spawned this issue, csvlint and csvclean are two tools that could be part of a solution to this problem.

max-mapper commented 9 years ago

my humble contribution https://github.com/maxogden/csv-spectrum