search

JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
https://crawlerdetect.io
MIT License
1.97k stars 256 forks source link

DuckduckGo bot is going unfiltered #370

Closed Abhirup-99 closed 4 years ago

MaxGiting commented 4 years ago

Can you please provide an example of the user agent.

Abhirup-99 commented 4 years ago

https://developers.whatismybrowser.com/useragents/explore/software_name/duckduckgo-favicons-bot/

MaxGiting commented 4 years ago

Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com) Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; http://duckduckgo.com) Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

All three user agents from the link you provided are detected as bots by crawler detect. Any user agent with the word bot is automatically detected.