search

sourcegraph / about

Sourcegraph blog, feature announcements, and website (about.sourcegraph.com)
https://about.sourcegraph.com
90 stars 169 forks source link

Noindex Code Search search results URLs #6773

Open fabicastp opened 4 months ago

fabicastp commented 4 months ago

This is part of our work to improve our SEO.

Context: Code Search search results pages (e.g., /search?q=”Error+1001”) are indexable by search engines. These currently drive minimal traffic, <10 clicks per day.

It’s best practice to make your onsite search non-indexable, because it’s possible to send search engines to an infinite combination of new URLs, diluting the effectiveness of the important URLs.

TO DO: Add a meta robots “noindex, nofollow” to all search results page URLs (?q=), while ensuring that sourcegraph.com/search is still indexable.

gitstart-app[bot] commented 4 months ago

Here is the GitStart Ticket for this issue: https://clients.gitstart.com/sourcegraph/3436/tickets/SGM-6773

gitstart-sourcegraph commented 4 months ago

Hi @fabicastp We have opened the issue here as most of the work will be done on the frontend app