mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Fatal transport error #90

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
ERROR [Crawler 6] Fatal transport error: Read timed out while fetching 
http://www.host.com/videos/browse?page=4&channel=7&per_page=18&sort=recent 
(link found in doc #78600)

Why I am getting this error when I started the crawler. And it is coming after 
a long duration of time when I started the crawler.

Original issue reported on code.google.com by jamalrai...@gmail.com on 26 Oct 2011 at 5:26

GoogleCodeExporter commented 9 years ago
Any update on this what does this error means?

Original comment by jamalrai...@gmail.com on 31 Oct 2011 at 10:02

GoogleCodeExporter commented 9 years ago
In general you should ignore this type of error while crawling the web. This 
one means that the web server is not responding to your request.

-Yasser

Original comment by ganjisaffar@gmail.com on 1 Nov 2011 at 4:22