search

mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Crawler doesn't follow relative links correctly #18

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. Use the sample from online
2. Create a page http://domain.com/foo/bar/
3. Have a <a href="test.php">test</a> on /foo/bar
4. Crawl http://domain.com/foo/

Expecting for the crawler to crawl http://domain.com/foo/bar/test.php

But the crawler follows http://domain.com/foo/test.php which is a 404

Original issue reported on code.google.com by finda...@gmail.com on 17 Oct 2010 at 11:40

GoogleCodeExporter commented 9 years ago 
It should be fixed in the new version. Please let me know if you still have 
this problem.

Thanks,
Yasser

Original comment by ganjisaffar@gmail.com on 11 Mar 2011 at 11:17