Closed grr closed 3 years ago
It's often useful to see how a site looks to google's crawlers. Also, it's useful to masquerade as Googlebot to bypass restrictions some sites put in place against human users.
A list of all google bot useragents: https://support.google.com/webmasters/answer/1061943?hl=en
There is a new "Bot" category on the list.
It's often useful to see how a site looks to google's crawlers. Also, it's useful to masquerade as Googlebot to bypass restrictions some sites put in place against human users.
A list of all google bot useragents: https://support.google.com/webmasters/answer/1061943?hl=en