mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Cannot handle page with 207 status code #116

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
I input a uri, and pageFetcher gets 207 status code, then the crawler stops.

Could the crawler take care of 207?

Thanks

Original issue reported on code.google.com by jessie.u...@gmail.com on 26 Jan 2012 at 11:49

GoogleCodeExporter commented 9 years ago
I think its implemented and available in the trunk. You can download the source 
and compile it. You can check it out here:

http://code.google.com/p/crawler4j/source/browse/src/main/java/edu/uci/ics/crawl
er4j/fetcher/CustomFetchStatus.java?spec=svn0161a713f264d504013c83f3152c2cd40366
a790&r=0161a713f264d504013c83f3152c2cd40366a790

http://code.google.com/p/crawler4j/source/detail?r=0161a713f264d504013c83f3152c2
cd40366a790

Original comment by w3engine...@gmail.com on 26 Jan 2012 at 5:10

GoogleCodeExporter commented 9 years ago
Can you provide an example url where this happens?

-Yasser

Original comment by ganjisaffar@gmail.com on 4 Feb 2012 at 11:34

GoogleCodeExporter commented 9 years ago
Will be reopened when a valid example will be present

Original comment by avrah...@gmail.com on 11 Aug 2014 at 1:07