Amazon CloudFront shouldn't be treated as crawler

JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

https://crawlerdetect.io

MIT License

1.96k stars 255 forks source link

Closed sunnydavis closed 4 years ago

sunnydavis commented 4 years ago

Amazon CloudFront is often the user agent for using CloudFront as reverse proxy / CDN so it's actually not a crawler but regular user requests.

JayBizzle commented 4 years ago

Fancy PRing that?

Thanks 👍🏻

sunnydavis commented 4 years ago

Sure, it's done. #410

JayBizzle commented 4 years ago

Merged 👍