search

jinty / prerender-cloudfront

prerender.io cloudfront example middleware
MIT License
127 stars 51 forks source link

Added googlebot, bingbot, and yandex to list of user agents #9

Closed thoop closed 6 years ago

thoop commented 6 years ago

Google is changing the way they crawl and will no longer crawl the _escapedfragment URLs. This adds a few user agents to future-proof this library and allow users to serve prerendered pages to the crawlers correctly. We have already updated out official middleware with this change as well.

Thanks!

thoop commented 6 years ago

Thanks so much!