search

Raku / doc-website

Tooling to build/run the documentation website
Artistic License 2.0
7 stars 10 forks source link

Prevent crawlers from indexing non-prod sites #385

Closed dontlaugh closed 3 months ago

dontlaugh commented 3 months ago

Introduce an env var configuration: PROD=true

If that is NOT set, then respond to robots.txt with a file that asks crawlers to stop indexing our site.

I will add this config to production once it lands.

dontlaugh commented 3 months ago

It's getting late here, so I'm going to merge this tomorrow. I'll need to ssh into prod to add PROD=true to the systemd unit file before I deploy.