petrbouchal / czgov-jobs

Scraper for Czech civil service jobs
0 stars 0 forks source link

Make scraper robust to failed fetching of individual lists #56

Open petrbouchal opened 8 years ago

petrbouchal commented 8 years ago

The entire scraper shouldn't fail when scraping a single page fails - it should skip, scrape the rest and write to DB