search

kevinelliott / agent_orange

Parse and process User Agents like a secret one
126 stars 36 forks source link

Facebook Crawler #18

Closed sabotatore closed 12 years ago

sabotatore commented 12 years ago

What do you think that Facebook Crawler should be defined as bot? It has "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)" user agent.

swrobel commented 12 years ago

+1

kevinelliott commented 12 years ago

The new improved bot detected that @lencioni contributed should catch the Facebook Crawler now.