wiki.lesswrong.com disallows all robots

[GoogleCodeExporter]

1. Search google for "rationalist taboo"
2. See "A description for this result is not available because of this site's 
robots.txt – learn more."
3. Load http://wiki.lesswrong.com/robots.txt
4. See "User-agent: *  Disallow: /"

Why block all robots from all pages?

Original issue reported on code.google.com by jeff.t.k...@gmail.com on 4 Sep 2013 at 5:52

[GoogleCodeExporter]

Original comment by wjmo...@gmail.com on 4 Sep 2013 at 11:14

• Changed state: Accepted
• Added labels: Milestone-Now, Priority-Top
• Removed labels: Milestone-Future, Priority-Low

[GoogleCodeExporter]

Thanks for reporting this Jeff. It's fixed now.

Original comment by wjmo...@gmail.com on 5 Sep 2013 at 1:27

• Changed state: Fixed

[GoogleCodeExporter]

Looks good!  Thanks!

Original comment by jeff.t.k...@gmail.com on 5 Sep 2013 at 1:50