search

mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Provide depth of crawling. #23

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Hi,
   I want to know where can we provide the depth of crawling in crawler4j?

What is the expected output? What do you see instead?
The Crawler crawls lot of data from a website.So i am unable to distinguish the 
depth of crawling for the given site.I want to provide a certain depth for 
crawling the site through the program.

What version of the product are you using? On what operating system?
crawler4j-2.2 and windows XP.

Please provide any additional information below.

Original issue reported on code.google.com by deepak.k...@gmail.com on 28 Dec 2010 at 8:50

GoogleCodeExporter commented 9 years ago 
can someone help or did you get the solution already ??

Original comment by mambena...@gmail.com on 26 Jan 2011 at 5:22

GoogleCodeExporter commented 9 years ago 
I would be interested in this functionality too.  Being able to limit depth 
turns out to be pretty important.

Original comment by mfkilg...@gmail.com on 10 Feb 2011 at 8:02

GoogleCodeExporter commented 9 years ago 
any news?

Original comment by gerb...@googlemail.com on 11 Feb 2011 at 5:04

GoogleCodeExporter commented 9 years ago 
It does not look like there is active development on this anymore...

Original comment by mfkilg...@gmail.com on 8 Mar 2011 at 9:52

GoogleCodeExporter commented 9 years ago 
Dear all,
Sorry for the long delay. I finally implemented this feature in the new 
version. Please read: http://code.google.com/p/crawler4j/#Crawl_depth

-Yasser

Original comment by ganjisaffar@gmail.com on 11 Mar 2011 at 11:33