Add an option to disable setting `X-Robots-Tag` header of routeRules

nuxt-modules / robots

Tame the robots crawling and indexing your Nuxt site.

https://nuxtseo.com/robots

MIT License

424 stars 34 forks source link

Closed HADB closed 3 months ago

HADB commented 3 months ago

Hi!

I'm deploying my site using the Cloudflare Pages Free Plan, which allows a maximum of 100 header rules in the _headers file.

Setting X-Robots-Tag to all routeRules will make _headers file exceed the limit and will ignore other necessary headers.

It will be better to have an option to disable setting headers like metaTag does for meta tag.

harlan-zw commented 3 months ago

Agreed! Contributions welcome otherwise will jump on it when I have a chance.