Search Engines indexing the old documentation

[farshidtz]

It looks like search engines (Google, Bing) prominently index the old versions of the documentation. This is misleading and a major issue for firstcomers. I believe the results can be fixed / influenced by us.

Checking first result for three queries in private browsing mode:

edgex core data

• https://www.google.com/search?q=edgex+core+data&oq=edgex+core+data
  • https://docs.edgexfoundry.org/1.2/microservices/core/data/Ch-CoreData/
• https://www.bing.com/search?q=edgex+core+data
  • https://docs.edgexfoundry.org/2.0/api/core/Ch-APICoreData/

edgex getting started

• https://www.google.com/search?q=edgex+getting+started
  • https://docs.edgexfoundry.org/1.2/getting-started/
• https://www.bing.com/search?q=edgex+getting+started
  • https://docs.edgexfoundry.org/2.1/getting-started/

edgex device sdk

• https://www.google.com/search?q=edgex+device+sdk
  • https://docs.edgexfoundry.org/2.2/microservices/device/sdk/Ch-DeviceSDK/
• https://www.bing.com/search?q=edgex+device+sdk
  • https://docs.edgexfoundry.org/2.1/getting-started/Ch-GettingStartedSDK

[jpwhitemn]

Fixed! After several iterations of work on both robots.txt and the sitemaps.xml (along with working with Google tools), we now have Google search appropriately returning the latest version of the docs on any search (ex: EdgeX core data). As we create each release/version, we'll have to update robots.txt and sitemap.xml. This should be something we explore with automation as we go forward.