spatie / robots-txt

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers
https://spatie.be/en/opensource/php
MIT License
219 stars 36 forks source link

Fixes "case-insensitive"-Rule in X-robots-tag #10

Closed RobinDev closed 5 years ago

RobinDev commented 5 years ago

Same as #9 but in Headers (https://developers.google.com/search/reference/robots_meta_tag).

I am pull-requesting in five minuts.

spatie-bot commented 5 years ago

Dear contributor,

because this issue seems to be inactive for quite some time now, I've automatically closed it. If you feel this issue deserves some attention from my human colleagues feel free to reopen it.