search

praveenbankbazaar / httparchive

Automatically exported from code.google.com/p/httparchive
0 stars 0 forks source link

Respect 301s #336

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. crawl www.bestelec.co.uk

What is the expected output? What do you see instead?
The initial request would be thrown away and the crawl would re-start using 
http://bestelec.co.uk as the base url

What version of the product are you using? On what operating system?
? odd question

Please provide any additional information below.

Original issue reported on code.google.com by nicksha...@gmail.com on 27 Sep 2012 at 8:16

GoogleCodeExporter commented 9 years ago

Original comment by stevesou...@gmail.com on 27 Sep 2012 at 9:05