search

saikiran321 / basic-browser-chess

Automatically exported from code.google.com/p/basic-browser-chess
0 stars 0 forks source link

Robots exclusion protocol #12

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Describe in detail what is desired: (Attach mockup pictures if applicable)
Add a robots.txt file

Give a short explanation of why you think the feature is useful:
Controls site access from web spiders

Original issue reported on code.google.com by Dennis.I.89 on 4 Aug 2010 at 5:28

GoogleCodeExporter commented 9 years ago 
currently set to:
allow all robots to crawl all files

Original comment by Dennis.I.89 on 5 Aug 2010 at 2:44