Closed GoogleCodeExporter closed 9 years ago
I got the same problem while having about 100 k + seeds in the db. After a
while and after restart the crawler seems to freeze. There is a lot of traffic
on the hard drive, looks like the db is reorganized or locked.
Did someone solve that problem?
Original comment by an.h...@gmail.com
on 16 Dec 2012 at 11:26
[deleted comment]
I am also facing the same problem freezing after a specified interval. Please
give your valuable suggestions.
Original comment by c.krithi...@gmail.com
on 24 Mar 2013 at 7:09
Please set config.setResumableCrawling to true and restart the crawler it will
start fetching from the last stopped location
Original comment by c.krithi...@gmail.com
on 31 May 2014 at 6:00
setting config.setResumableCrawling is not an option for me. Anyone figure out
what is causing this?
Original comment by jeger...@gmail.com
on 17 Jul 2014 at 2:55
I need a more specific scenario.
I need the list of URLs to test for myself.
Original comment by avrah...@gmail.com
on 11 Aug 2014 at 2:14
Closed due to inactivity and no good scenario
Original comment by avrah...@gmail.com
on 23 Sep 2014 at 2:05
Original issue reported on code.google.com by
misterbu...@gmail.com
on 11 Oct 2012 at 8:29