varnishcache / varnish-devicedetect

VCL based device detection for Varnish Cache.
Other
300 stars 88 forks source link

new google mobile-bot #32

Closed pippoppo closed 8 years ago

pippoppo commented 8 years ago

Hi, according to this page: https://support.google.com/webmasters/answer/1061943 google has a new mobile bot, maybe (as per our analysis) since April 19th

In order to catch it, I've made a little change in the vcl, this one:

43c43

< (req.http.User-Agent ~ "iPhone" && req.http.User-Agent ~ "(compatible; Googlebot/2.1; +http://www.google.com/bot.html")) {

        (req.http.User-Agent ~ "(iPhone|Android)" && req.http.User-Agent ~ "\(compatible; Googlebot/2.1; \+http://www.google.com/bot.html")) {

let me know if you need a pull request

thanks, corrado

pippoppo commented 8 years ago

http://searchengineland.com/google-change-smartphone-user-agent-googlebot-iphone-android-april-18th-244779

mjacksonw commented 8 years ago

Should this just look for "Mobile", which appeared in both and would likely continue to appear amidst future changes? https://webmasters.googleblog.com/2014/01/a-new-googlebot-user-agent-for-crawling.html

TracKer commented 8 years ago

Can you please merge this in, because it's breaking google bot's detection.

behid commented 8 years ago

I've created a PR for Google Bot new user agent and Bing Bot detection: #33

KeyserSosa commented 8 years ago

merged, thanks!