Closed GoogleCodeExporter closed 9 years ago
If you have a few seeds, initially, the first thread is assigned the URLs of
these seeds and then the others would wait for new URLs to be added to the URLs
queue. So, this is the expected behavior.
Original comment by ganjisaffar@gmail.com
on 8 Jun 2011 at 10:53
How much exactly that "Few seeds" mean? Also if the crawl is started with max
depth 0, then how will it utilize the created threads? Is there a work around
for making it use all the created threads for seed urls?
Original comment by mvi...@owler.com
on 6 Jun 2013 at 12:25
Original issue reported on code.google.com by
haggai.s...@gmail.com
on 8 Jun 2011 at 2:42