search

hlxsites / servicenow

Apache License 2.0
2 stars 3 forks source link

Customer needs to update robots.txt #207

Closed andreituicu closed 4 months ago

andreituicu commented 7 months ago

At the time of the golive cutover, the customer must update their robots.txt to include the blogs sitemap and disallow list.

https://www.servicenow.com/robots.txt

See Slack thread here for contacts: https://adobe-dx-support.slack.com/archives/C05LRE7PRQ8/p1702309718745549 Add

Sitemap: https://www.servicenow.com/blogs/sitemap.xml

Add

Disallow: /blogs/fragments/*
Disallow: /blogs/drafts/*
Disallow: /uk/blogs/fragments/*
Disallow: /uk/blogs/drafts/*
Disallow: /fr/blogs/fragments/*
Disallow: /fr/blogs/drafts/*
Disallow: /de/blogs/fragments/*
Disallow: /de/blogs/drafts/*
Disallow: /nl/blogs/fragments/*
Disallow: /nl/blogs/drafts/*
andreituicu commented 4 months ago

Done. ServiceNow went live and they configured robots.txt.