openaustralia / australian_local_councillors_popolo

Popolo data for Local Councillors in Australia
Other
6 stars 6 forks source link

Automate the process of appending/merging a CSV with updates into the state CSVs #129

Closed equivalentideas closed 7 years ago

equivalentideas commented 7 years ago

PlanningAlerts has a CSV API for the updates to their councillor data, e.g. https://www.planningalerts.org.au/authorities/61/councillor_contributions/12.csv

This application should know how to integrate updates like that, because it's messy/error prone for humans to update these big CSV files manually.

This is part of https://github.com/openaustralia/planningalerts/issues/1203

equivalentideas commented 7 years ago

Here's the steps that are emerging:

equivalentideas commented 7 years ago

With c3e011a we now have a rake task for requesting updates from a remote CSV, merging them into our CSV and then generating popolo.

equivalentideas commented 7 years ago

I'd say this issue is done with those bits ticket off https://github.com/openaustralia/australian_local_councillors_popolo/issues/129#issuecomment-332718516