Closed devinaconley closed 7 years ago
Write a generic scraper for any Socrata dataset given some json config specifying endpoint, metric, city, field-names, etc.
This should allow us to consolidate a lot of scraper code and easily run a large batch of scrapers, moving in the direction of automation
Going to try to tackle this now
Write a generic scraper for any Socrata dataset given some json config specifying endpoint, metric, city, field-names, etc.
This should allow us to consolidate a lot of scraper code and easily run a large batch of scrapers, moving in the direction of automation