Add hooks in the webcrawler for better error handling

xrma / crawler4j

Automatically exported from code.google.com/p/crawler4j

0 stars 0 forks source link

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago

We should add better hooks in the WebCrawler in which we could better control 
various errors while crawling a certain URL.

Original issue reported on code.google.com by avrah...@gmail.com on 17 Aug 2014 at 11:50

GoogleCodeExporter commented 9 years ago

Fixed in revision hash: 6bdccbd254d0

Original comment by avrah...@gmail.com on 17 Aug 2014 at 11:57

GoogleCodeExporter commented 9 years ago

Original comment by avrah...@gmail.com on 17 Aug 2014 at 6:02