nikhilgeit / abot

Automatically exported from code.google.com/p/abot
Apache License 2.0
0 stars 0 forks source link

Retry crawl on webexception because of a bad proxy #124

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
Problem:
When a webexception occurs in the CrawlPageCompleted event and you want to 
re-crawl the website again (with a different proxy), Abot won't let you add the 
site to the scheduler.

Solution:
https://groups.google.com/d/msg/abot-web-crawler/aD6Q5L8zYxE/rSPuYHZ4vCUJ
and
https://groups.google.com/d/msg/abot-web-crawler/aD6Q5L8zYxE/k62wuc0JeNYJ

Original issue reported on code.google.com by skage...@googlemail.com on 5 Jan 2014 at 8:17

GoogleCodeExporter commented 8 years ago

Original comment by sjdir...@gmail.com on 20 Jan 2014 at 1:46