handle symlinking of robots.txt

augustash / capistrano-ash

August Ash recipes for Capistrano

http://augustash.com

MIT License

73 stars 12 forks source link

Closed grafikchaos closed 10 years ago

grafikchaos commented 13 years ago

Staging environment's version of robots.txt should block all search engines from indexing the site

User-agent: * - Disallow: /

dficker commented 11 years ago

I think it would at least be great if the disallow all robots.txt is automatically written for staging.

grafikchaos commented 10 years ago

closed via 39e4744a1a4b2fec834078d774116bee06194671