asepaprianto / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Error during crawling - Not immediate (after several days of crawling) : Error while getting next urls [...] Java Error occurred, recovery may not be possible. #219

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
First, it is a great tool. Functional within few minutes.

But my problem is:

When i launch the crawler, it works (several days) without any errors. But 
suddenly i see the message " Error while getting next urls: (JE 4.0.92) 
JAVA_ERROR: Java Error occurred, recovery may not be possible." in the log file 
(without any other explanations).

I am using crawler4j 3.3 and its dependencies with Java 1.6.

Perhaps it is due to JE component but I have not found anything about it on 
Google.

Regards,
Emmanuel

Original issue reported on code.google.com by zygolech...@gmail.com on 13 May 2013 at 6:38

GoogleCodeExporter commented 9 years ago
Sorry, I need a more exact scenario.

On top of my head it sounds like heap memory space problem

Original comment by avrah...@gmail.com on 11 Aug 2014 at 2:43

GoogleCodeExporter commented 9 years ago
Closed due to inactivity and no good scenario

Original comment by avrah...@gmail.com on 23 Sep 2014 at 2:10