search

inviqa / inviqa-seed-default

Deprecated in favour of https://github.com/my127/workspace
2 stars 1 forks source link

Provide per-env robots.txt support in cap #24

Open mikesimons opened 9 years ago

mikesimons commented 9 years ago

A suggestion from @tkitchin-inviqa & @gstaniforthsessiondigital; disable indexing on staging by default.

Initial suggestion was to include a Disallow all robots.txt in the seed by default but this will have problems when moving to live if it is fixed in place.

I propose we define a standard location for robots.txt files and symlink / copy them in to webroot at deploy based on the env. This enables per-env robots.txt files which can be tracked in git and only require a cap deploy to update.

andytson commented 9 years ago

Magento always embeds it's indexing information in it's html pages via meta robots. It is defined as a system configuration setting. Magento Demo data has it set to noindex/nofollow, Magento fresh install has it set to index/follow