search

AmberishSingh / abot

Automatically exported from code.google.com/p/abot
Apache License 2.0
0 stars 0 forks source link

RobotsDotText implementation disallows all external pages #118

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
RobotsDotText implementation disallows all external pages. This impl should 
ignore pages that are external.

Original issue reported on code.google.com by sjdir...@gmail.com on 27 Sep 2013 at 12:39

GoogleCodeExporter commented 8 years ago 
Fixed, attached the two files that needed to be changed. Checked into github 
https://github.com/sjdirect/abot/commit/9393af00f5a36a1dbe01ae350901f684d9fc7d88

Original comment by sjdir...@gmail.com on 27 Sep 2013 at 12:49

Attachments:

GoogleCodeExporter commented 8 years ago

Original comment by sjdir...@gmail.com on 27 Sep 2013 at 4:38