Add 4 new crawlers. Add scraper as a catch all word

JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

https://crawlerdetect.io

MIT License

1.97k stars 256 forks source link

Closed MaxGiting closed 4 years ago