search

asepaprianto / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Don't let a crawled URL to be dropped without proper logging #276

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Each URL should be logged somehow so the user will know it was crawled.

We shouldn't just drop URLs without logging them (warn / debug, depends on the 
case)

Original issue reported on code.google.com by avrah...@gmail.com on 13 Aug 2014 at 7:51

GoogleCodeExporter commented 9 years ago 
Logging statements added.

Revision hash: 384d98113c86

Original comment by avrah...@gmail.com on 13 Aug 2014 at 7:09