Use calendar data to tune scraper.

guelo / councilmatic

Oakland City Council Legislative Information

11 stars 3 forks source link

Use calendar data to tune scraper. #29

Open paulcw opened 11 years ago

paulcw commented 11 years ago

Rather than just scraping daily or weekly, we could tune the scraper to dig deeper based on the contents of the calendar. Things on the agenda are more likely to change, so we could use that to make the scraper look for more volatile legislation data.

Depends on #28 .

techieshark commented 9 years ago

How long does scraping take? Why not just do it daily?