nprapps / leso

Processing scripts for Defense Logistics Agency LESO data
http://blog.apps.npr.org/2014/09/02/reusable-data-processing.html
MIT License
8 stars 2 forks source link

Handle agency specific data #19

Closed eads closed 9 years ago

eads commented 9 years ago

We have XLSX files for every state we've FOIA'd with agency specific data. I wrote a script (available in the refactor_cleaner branch) to mash these all into one big CSV. But for some reason the CSV is a little off:

Import state-specific.csv to database
CREATE TABLE
ERROR:  extra data after last expected column
CONTEXT:  COPY state_specific, line 2: "14TH JUDICIAL DIST DTF,TRACKED,,D,1,2YTACV,000000-0000-00000,10,1005,1.0,"TYPE=M16A1 DESC=RIFLE,5.56..."
eads commented 9 years ago

Thanks @TylerFisher