phundament / app

Dockerized Yii2 web application base
http://phundament.com
Other
310 stars 129 forks source link

Default robots.txt in development #120

Open schmunk42 opened 10 years ago

schmunk42 commented 10 years ago
User-agent: *
Disallow: /

# This robots.txt is part of the development configuration.
# It locks out all search engine bots from crawling.
# This file MUST NOT BE INCLUDED in PRODUCTION ENVIRONMENT.

@Quexer69 @marc7000 @disco-tex77 Should we add something like this? Eg. in environments/development/frontend/web or ....../backend/web?