Set X-Robots to prevent future accidental indexing of dev/staging sites

mautic / website

The Mautic Website

6 stars 4 forks source link

Set X-Robots to prevent future accidental indexing of dev/staging sites #84

Closed RCheesley closed 5 years ago

RCheesley commented 5 years ago

See #61 for original issue.

Ideally we should use an X-Robots tag at the server level to block any development or staging sites from being indexed, and we should have a robots.txt as a fallback.

RCheesley commented 5 years ago

No longer relevant