Make the version of robots.txt different for production

springload / madewithwagtail

A showcase of sites and apps made with Wagtail CMS, the easy to use, open source Django content management system

http://madewithwagtail.org

MIT License

84 stars 21 forks source link

Closed AndrewCalderSpringload closed 5 months ago

AndrewCalderSpringload commented 5 months ago

This PR introduces separate versions of robots.txt for production and non-production.

The purpose of this is to prevent google from indexing non-production environments.