search

bellroy / lesswrong

Less Wrong platform
http://lesswrong.org/
Other
45 stars 23 forks source link

wiki.lesswrong.com disallows all robots #504

Closed frediy closed 9 years ago

frediy commented 9 years ago

From jeff.t.k...@gmail.com on September 05, 2013 03:52:06

  1. Search google for "rationalist taboo"
  2. See "A description for this result is not available because of this site's robots.txt – learn more."
  3. Load http://wiki.lesswrong.com/robots.txt 4. See "User-agent: * Disallow: /"

Why block all robots from all pages?

Original issue: http://code.google.com/p/lesswrong/issues/detail?id=407

frediy commented 9 years ago

From wjmo...@gmail.com on September 04, 2013 16:14:12

Status: Accepted
Labels: -Priority-Low -Milestone-Future Priority-Top Milestone-Now

frediy commented 9 years ago

From wjmo...@gmail.com on September 04, 2013 18:27:58

Thanks for reporting this Jeff. It's fixed now.

Status: Fixed

frediy commented 9 years ago

From jeff.t.k...@gmail.com on September 04, 2013 18:50:30

Looks good! Thanks!