Not working properly with: x-robots-tag: none

spatie / robots-txt

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

https://spatie.be/en/opensource/php

MIT License

219 stars 36 forks source link

Closed nnerijuss closed 3 years ago

nnerijuss commented 3 years ago

Not working properly with: x-robots-tag: none.

This tag is equal to noindex and nofollow, but ->mayIndex() and ->mayFollow() returns true

freekmurze commented 3 years ago

Feel free to send a PR to fix this 👍

nnerijuss commented 3 years ago

@freekmurze can we expect merge any time soon ?

freekmurze commented 3 years ago

We'll handle this further in #30