Big chicago scrape - Githubissues

opencivicdata / python-legistar-scraper

Scrapes municipal data from Legistar websites

BSD 3-Clause "New" or "Revised" License

42 stars 28 forks source link

Big chicago scrape #95

Closed fgregg closed 5 years ago

fgregg commented 5 years ago

this fixes a couple of issues surfaced by the big chicago scrape

sometimes there are dupes in legislative histories
sometimes a vote url is a 404

I'm not sure what our policy is for mocking requests. If we want to always mock them, then could you provide some guidance on best way to do this for pages we don't want to refresh?

fgregg commented 5 years ago

I went ahead and followed the mocking pattern you had started.

fgregg commented 5 years ago

@hancush I've responded to your comments.