spatie / robots-txt

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers
https://spatie.be/en/opensource/php
MIT License
219 stars 36 forks source link

Fix deprecation message #41

Closed buismaarten closed 10 months ago

buismaarten commented 10 months ago

PHP Deprecated: trim(): Passing null to parameter #1 ($string) of type string is deprecated in .../php-crawler/vendor/spatie/robots-txt/src/RobotsTxt.php on line 53

freekmurze commented 10 months ago

Thanks!