search

rook / rook.github.io

Apache License 2.0
25 stars 31 forks source link

SEO: Disable indexing of old versions #91

Closed dnlsndr closed 4 years ago

dnlsndr commented 4 years ago

I've noticed that every time I seach something on google that has to do with rook, I always land on the v0.8 documentation page and not on the latest version. It would be better if one could give the old versions as well as the master branch a "nodinex" meta tag, so google doesn't index those sites. In my opinion the majority of users will always use the latest version of rook thus outweighing the users that still use v0.8.

jbw976 commented 4 years ago

This is a great idea, thanks for opening this issue @onmyflow. @galexrt do you know if this is easily supported via config by Gatsby? Hopefully this would be an easy setting to turn on :)

galexrt commented 4 years ago

@jbw976 Gatsby? As far as I know Jekyll is used, but yeah that should be possible.

jbw976 commented 4 years ago

I get Jekyll and Gatsby confused, sorry! 😕

someone else also suggested updating robots.txt to exclude older versions of the docs, if Jekyll doesn't have easy native support

galexrt commented 4 years ago

@jbw976 We can do it through robots.txt as well though "officially" wildcards are not supported (heavily depends on the robots) ;-)

I have created #92 to use the meta noindex tag method.