Improve bot detection regex

kevinelliott / agent_orange

Parse and process User Agents like a secret one

126 stars 36 forks source link

Closed lencioni closed 11 years ago

lencioni commented 12 years ago

This pull request improves the bot detection regex by:

adding a number of missing strings, such as alexa, facebookexternalhit, feedburner, google web preview, nagios, postrank, pingdom, slurp, yahoo!, and yandex
removing redundant strings such as googlebot and robot (redundant because of the inclusion of a general "bot" string)
consolidating similar strings ("crawler" and "crawling" became "crawl(er|ing)")
alphabetizing the list of bots

lencioni commented 12 years ago

It looks like this may address Issues #14 and #18

ghost commented 12 years ago

This would be helpful to us at Causes.

twobitlabs commented 11 years ago

+1 for this!

kevinelliott commented 11 years ago

I'll get this tested and merged in very soon!

On Sep 14, 2012, at 4:03 PM, Two Bit Labs notifications@github.com wrote:

+1 for this!

— Reply to this email directly or view it on GitHub.