In order to run multiple instances of a site (sandbox, stage, prod, etc), we need control over the robots meta tag, so we don't index things on Google that we don't want indexed.
Typically, this will be done via plugin, but the theme should have a backstop to prevent searches and 404s from being indexed since this should never happen - even on production sites.
spelkey-ucd
commented
1 year ago
In order to run multiple instances of a site (sandbox, stage, prod, etc), we need control over the robots meta tag, so we don't index things on Google that we don't want indexed.
Typically, this will be done via plugin, but the theme should have a backstop to prevent searches and 404s from being indexed since this should never happen - even on production sites.