Googlebot user agent - Githubissues

Dax89 / WebPirate

A Tabbed, WebKit based Browser Web for SailfishOS

GNU General Public License v3.0

15 stars 7 forks source link

Googlebot user agent #67

Closed Mikaela closed 8 years ago

Mikaela commented 8 years ago

List of user-agent strings of Googlebot: https://support.google.com/webmasters/answer/1061943

It would be nice to have option to send Googlebot user-agent as paywalls tend to let it through for indexing articles and I hate paywalls especially on my phone.