XenitAB / xenitab.github.io

Repository gathering documentation for Xenit open source projects
https://xenitab.github.io/
MIT License
7 stars 1 forks source link

Google is not indexing our docs #79

Open bittrance opened 2 years ago

bittrance commented 2 years ago

The following search https://www.google.com/search?q=site%3Axenitab.github.io+ingress should reasonably find something, but does not. I think this is because Docusaurus requires JavaScript to render the page, which Google probably refuses to do (nominally, Google does render JavaScript, but it has to be careful and I would not hold it against them if they simply skipped low-pagerank sites that present no content at all before rendering). Also, Docusaurus will not materialize menu tree nodes until the user clicks the parent, so Google would anyway not see more than a few top pages.

NissesSenap commented 2 years ago

I have spoken to @CalleB3 and asked him to look in to this. The plan is as follows:

So if there is a simple config value that we can set in Docusaurus that makes it possible to index the homepage. If that is not the case we will leave Docusaurus and instead go over to https://gohugo.io/

Going over to hugo is obviously a much bigger task.

My recommendation is to play with a repo in your own github or if you use a new branch for this repo to save your ongoing work.

ahockersten commented 2 years ago

It may be worth noting that Bing appears to be indexing our site, so it's not "unindexable" by any means (which I don't think anyone has claimed - obviously other Docusaurus sites seem to be indexed). https://www.bing.com/search?q=site%3Axenitab.github.io+kubernetes&form=QBLH&sp=-1&pq=site%3Axenitab.github.io+kubernete&sc=0-32&qs=n&sk=&cvid=2CC6A3B590764A50B049A528AF1456A3