Use the new Google robots meta tag attributes

Financial-Times / n-ui

❌ DEPRECATED Server, build and client side bootstrapping for FT.com's user-facing applications.

7 stars 5 forks source link

Use the new Google robots meta tag attributes #1507

Closed bjfletcher closed 5 years ago

bjfletcher commented 5 years ago

Google has introduced new robots meta tag attributes, specifically max-snippet and max-image-preview. These settings will hopefully improve our SEO performance.

See the Google doc for more on these attributes.

Talk to me, Matt Bailey (Product Manager) or James Webb if you have any questions about this.

Page Kit PR for the future: https://github.com/Financial-Times/dotcom-page-kit/pull/618

i-like-robots commented 5 years ago

I'm not sure what the effect of this will be as apps may already declare a robots tag themselves, e.g. https://github.com/Financial-Times/next-article/blob/62da871e473537ce0860099e31c3553cce1d833f/views/content.html#L5-L7

I don't know if it's valid to have both or what will happen when the values contradict as above.

bjfletcher commented 5 years ago

@i-like-robots Google says it should be ok:

If the page contains multiple meta tags of the same type, we will aggregate the content values. For instance, we will interpret

<META NAME="ROBOTS" CONTENT="NOINDEX">
<META NAME="ROBOTS" CONTENT="NOFOLLOW">

The same way as:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

If content values conflict, we will use the most restrictive. So, if the page has these meta tags:

<META NAME="ROBOTS" CONTENT="NOINDEX">
<META NAME="ROBOTS" CONTENT="INDEX">

We will obey the NOINDEX value.