let the webscraper retries be settable

opencivicdata / python-legistar-scraper

Scrapes municipal data from Legistar websites

BSD 3-Clause "New" or "Revised" License

42 stars 28 forks source link

let the webscraper retries be settable #99

Closed fgregg closed 5 years ago

fgregg commented 5 years ago

Currently, the web scraper associated with the API event scrape classes cannot retry an event. If there's an intermittent error (as there often is), then this makes the scrape fail. This PR makes the number of retries settable as a class attribute and sets it to 3 by default.