search

tasfe / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 1 forks source link

Crawler4j does not crawl to a broken link #242

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
I am using my using crawler4j API to crawl my website and get all the broken 
links. But it never crawls to any broken link.

Original issue reported on code.google.com by s...@vivareal.com on 18 Nov 2013 at 6:46

GoogleCodeExporter commented 9 years ago 
Yes it does.

Now that we have added more logging you can see all of the broken links.

Just use the latest release from trunk and you will see all of the logs (or any 
stable version after v3.5)

Original comment by avrah...@gmail.com on 17 Aug 2014 at 5:13

GoogleCodeExporter commented 9 years ago 
Not a bug or feature thus moved to the forum

Original comment by avrah...@gmail.com on 17 Aug 2014 at 5:14