Closed GoogleCodeExporter closed 9 years ago
Each URL should be logged somehow so the user will know it was crawled. We shouldn't just drop URLs without logging them (warn / debug, depends on the case)
Original issue reported on code.google.com by avrah...@gmail.com on 13 Aug 2014 at 7:51
avrah...@gmail.com
Logging statements added. Revision hash: 384d98113c86
Original comment by avrah...@gmail.com on 13 Aug 2014 at 7:09
Original issue reported on code.google.com by
avrah...@gmail.com
on 13 Aug 2014 at 7:51