search

guelo / councilmatic

Oakland City Council Legislative Information
11 stars 2 forks source link

Come up with optimal scraper schedule #2

Closed guelo closed 11 years ago

guelo commented 11 years ago

The scraper should ideally only scrape newer and updated items since the last time it scraped. There seems to be some logic for this in the code but it is not used.

Also, feeds and other tasks in job.template.

Use Legistar rss feed to get last updated date.

guelo commented 11 years ago

Closing this one to work on #29 instead.