Prevent sites being indexed by search engines

[dennisboris]

Is your feature request related to a problem? Please describe. I want to prevent some sites to be indexed by search engines.

Describe the solution you'd like A checkbox to prevent a site being indexed or the option to add custom headers like: add_header X-Robots-Tag "noindex, nofollow, nosnippet, noarchive";

Describe alternatives you've considered Adding the header by adding a location block in the custom configuration but it requires me to write my own location block configuration. That I don't understand completely I think because I can't load some sites afterwards.

location / {
    proxy_pass http://192.168.2.10:8123;
    add_header  X-Robots-Tag "noindex, nofollow, nosnippet, noarchive";
}

Additional context I hope is is possible to add this feature and I think a lot of people are interested in it.

[dl-lim]

Definitely need this. Any workarounds until someone gives an update?

Do we have to write every single proxy_pass for every subdomain?

[schmurtzm]

Looking for this option too 🙂

[tristanXme]

Would also love to have this

[Aceriz]

would agree it would be great to have this

[HidYn]

I was able to get this working by adding the below to the advanced section of a host you don't want indexed.

location = /robots.txt {
  add_header  Content-Type  text/plain;
  return 200 "User-agent: *\nDisallow: /\n";
}

[LDprg]

any updates on this

[wanderling]

Start a bounty. I'll pitch in for this feature.

[github-actions[bot]]

Issue is now considered stale. If you want to keep it open, please comment :+1: