search

cloudogu / ecosystem

Cloudogu Ecosystem is an open platform, which lets you choose how and where your team creates great software. Each service or tool is delivered as a Dōgu, a Docker container, that can be easily integrated in your environment just by pulling it from our registry.
http://cloudogu.com
GNU Affero General Public License v3.0
42 stars 13 forks source link

exclude ecosystem from searchengine crawlers #345

Open merlinstuckenbrock opened 7 years ago

merlinstuckenbrock commented 7 years ago

Ecosystem instances should have the possibility to configure the searchability from google and other searchengines. Therefore a robots.txt should be configurable during setup process.

tgrosser commented 7 years ago

I can‘t imagine any reason for having a development platform, which is password protected, be findable by search engines. There is no need for a configuration option. Just install a default robots.txt which kerps away crawlers.