The package is not detecting Ahrefs as a crawler

JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

https://crawlerdetect.io

MIT License

1.98k stars 256 forks source link

The package is not detecting Ahrefs as a crawler #495

Closed mkrvaric closed 1 year ago

mkrvaric commented 1 year ago

This line from the access log, is not detected as a crawler. Why Ahrefs bot is not included?

54.36.149.243 - - [29/Jun/2023:08:10:28 +0000] "GET /hr/proizvod/tajice-nike-w-pro-365-tight-35524 HTTP/2.0" 200 16858 "-" "Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)"

JayBizzle commented 1 year ago

Works for me https://crawlerdetect.io/?q=Mozilla/5.0%20(compatible;%20AhrefsSiteAudit/6.1;%20+http://ahrefs.com/robot/site-audit)