search

gbif / portal-feedback

User feedback for the GBIF API, website and published data. You can ask questions here. 🗨❓
30 stars 16 forks source link

Do not index translations #4955

Open gbif-portal opened 1 year ago

gbif-portal commented 1 year ago

Do not index translations

Apparently our translated versions get indexed. That is great for content that is actually translated, but for dataset pages like this one it seems silly that the first google result i get when searching for the dataset title is the arabic version. Should we ask robots not to index anything but the english language versions for everything but contentful pages?

For contentful driven data I'm not sure what to do, since I'm not sure if we have a good way to tell if a page is actually translated or not. But ideally I suppose we would only ask search engines to index pages that was actually translated.

Github user: @MortenHofft User: See in registry - Send email System: Chrome 116.0.0 / Mac OS X 10.15.7 Referer: https://www.gbif.org/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c Window size: width 2086 - height 1550 API log&_a=(columns:!(_source),filters:!(),index:'3390a910-fcda-11ea-a9ab-4375f2a9d11c',interval:auto,query:(language:kuery,query:''),sort:!())) Site log&_a=(columns:!(_source),filters:!(),index:'5c73f360-fce3-11ea-a9ab-4375f2a9d11c',interval:auto,query:(language:kuery,query:''),sort:!())) System health at time of feedback: OPERATIONAL

MattBlissett commented 1 year ago

I thought these links:

<link rel="alternate" hreflang="en" href="https://www.gbif.org/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c />
<link rel="alternate" hreflang="ar" href="https://www.gbif.org/ar/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c" />
<link rel="alternate" hreflang="x-default" href="https://www.gbif.org/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c" />

were supposed to mean Google would send someone with their browser set to Arabic (or at least, that they think speaks Arabic) to https://www.gbif.org/ar/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c but an English speaker to https://www.gbif.org/dataset/226064ec-8b44-44c5-ae67-b98a9598e58c

It looks fine according to https://developers.google.com/search/docs/specialty/international/localized-versions and https://technicalseo.com/tools/hreflang/

It even says pages where the main content isn't translated (like forums) are fine to use this method.

MortenHofft commented 1 year ago

I thought so as well. But it is not what I see in search results. So I'm trying to be pragmatic.