search

WhichBrowser / Parser-PHP

Browser sniffing gone too far — A useragent parser library for PHP
http://whichbrowser.net
MIT License
1.79k stars 240 forks source link

Removing support for `Gocrawl` detection #592

Closed summercms closed 3 years ago

summercms commented 3 years ago

The user agent for Gocrawl is as follows:

Googlebot (gocrawl v0.4)

From reading the closed issue found here: https://github.com/PuerkitoBio/gocrawl/issues/41

The author has said the following: https://github.com/PuerkitoBio/gocrawl/issues/41#issuecomment-139579686

  1. That package uses the name Googlebot in it's user agent but does not own or have any rights to Google's copyright in using their name!

  2. This repo has been setup to detect fake bots and that user agent will be flagged now and will fail test runner.

  3. The author even suggests for people to use their newer package called fetchbot which doesn't use the name GoogleBot

  4. Most firewall's block this spoofing attack.

Going to remove support for this third-party library as it is creating incorrect results and will not pass.