Exclude tags from sitemap (and return no-index header on them) - Google 2023 Helpful Content Update

[sergiorodenas]

Feature Request

Google has recently released an update on the algorithm that benefits webpages when a high % of the indexed pages are helpful for the final user. Flarum applications might have tags of non-really-searchable-interest as "Praise" or "Test posting" in the case of the current Flarum community forum.

Describe the solution you'd like

We could:

• Allow to exclude the posts of specific tags from the sitemap.
• Allow to also return a noindex param on them. This would tell Google to deindex the posts. This can be done either by returning a <meta name="robots" content="noindex"> on the HTML or X-Robots-Tag: noindex on response headers.

What do you think?

Thank you so much for all the efforts!! Long live Flarum!!

[sergiorodenas]

I believe this could be very helpful for many sites