search

opengovernment / legistar-scrape

a python library for scraping Legistar sites and storing in to a Mongo database
2 stars 1 forks source link

Parameterize scraping #3

Open rchekaluk opened 11 years ago

rchekaluk commented 11 years ago

The current scraper hardcodes pa-philadelphia; this scraper should be parameterized so we can scrape different local governments by providing alternate command line arguments.

rchekaluk commented 11 years ago

Or, simply rename the existing import.py to pa-philadelphia.py to note that the script only scrapes Philadelphia data.

rchekaluk commented 11 years ago

Are we not planning a ca-san-jose legistar scraper?

derekeder commented 11 years ago

I added a settings file so we can specify multiple municipalities. Take a look at https://github.com/opengovernment/legistar-scrape/blob/master/settings.py.example

rchekaluk commented 11 years ago

Is there a plan for a ca-san-jose legistar scraper?

derekeder commented 11 years ago

@rchekaluk unsure on ca-san-jose status. thoughts, @davidmooreppf?