search

codeforbirmingham / Open-Disclosure

Understanding Alabama Campaign Finance Data
http://www.codeforbirmingham.org/Open-Disclosure/
17 stars 6 forks source link

Flatten JSON arrays #82

Closed agrueneberg closed 9 years ago

agrueneberg commented 9 years ago

It looks like Socrata does not import JSON arrays. I get ~30 errors when uploading transactions (only a those few have the endorsers field) and the transactees dataset fails completely. Once we have addressed #81, we should introduce a new step in the data pipeline that flattens the JSON.

agrueneberg commented 9 years ago

Thanks! Depending on the data access patterns of our client application (and Socrata's capabilties—it doesn't support joins) we might have to revisit this at a later point to find a more efficient solution for the 1:m relationship between transactee and transactions. But for now, this is a good start.