Scrapers failure count - Githubissues

hackforla / jobs-for-hope

Aggregate job opportunities for homeless service providers so that people can search for a job in the non-profit sector that fits their skillset.

MIT License

20 stars 20 forks source link

Scrapers failure count #115

Open fyliu opened 5 years ago

fyliu commented 5 years ago

Store scraper failures in the organizations table. Increment each time the scraper fails so that we can disable the scraper later if it fails too many times without successing. Clear the failure count on successful scraping.