crossin / bgweb

Automatically exported from code.google.com/p/bgweb
0 stars 0 forks source link

status in_normal sites #6

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. some sites with status code 3 will not be spidered
2. caused by historic reasons
3.

What is the expected output? What do you see instead?
all sites correctly displayed.

Please use labels and text to provide additional information.
all parsing engines are turning to regular expression parsers
these problems will be fixed.

Original issue reported on code.google.com by zinking3 on 19 Oct 2010 at 1:20