search

daytonaio / docs

Official Documentation for Daytona
https://daytona.io/docs
Apache License 2.0
32 stars 12 forks source link

Sitemap #196

Closed Tpuljak closed 5 days ago

Tpuljak commented 6 days ago

We should add a sitemap to the page so that crawlers have an easier job indexing. This is especially important for search.

ivan-burazin commented 6 days ago

@Tpuljak we need to make sure that this sitemap is indexed in the main sitemap as its all one website. this is not a sub domain

stefanicjuraj commented 6 days ago

There could also be an additional sitemap in the documentation repository dedicated only to documentation pages.

This would allow for automatic updates and indexing of the sitemap with each deploy (same as text files for llms).

Here is the current state of the sitemap for the documentation if needed for the main sitemap:

https://www.daytona.io/docs/ https://www.daytona.io/docs/about/what-is-daytona/ https://www.daytona.io/docs/about/getting-started/ https://www.daytona.io/docs/installation/installation/ https://www.daytona.io/docs/configuration/git-providers/ https://www.daytona.io/docs/configuration/providers/ https://www.daytona.io/docs/configuration/targets/ https://www.daytona.io/docs/usage/workspaces/ https://www.daytona.io/docs/usage/projects/ https://www.daytona.io/docs/usage/prebuilds/ https://www.daytona.io/docs/usage/ide/ https://www.daytona.io/docs/usage/builders/ https://www.daytona.io/docs/usage/server/ https://www.daytona.io/docs/tools/cli/ https://www.daytona.io/docs/tools/api/ https://www.daytona.io/docs/tools/docker-extension/ https://www.daytona.io/docs/misc/telemetry/ https://www.daytona.io/docs/misc/troubleshooting/

@Tpuljak @ivan-burazin

ivan-burazin commented 6 days ago

not sure. as per sitemap format there should be a main sitmap.xml and it can include others. so we need to properly structure that

cc @fabjanvucina

Tpuljak commented 5 days ago

We could have a main sitemap that includes the docs sitemap but the indexing of the search could scrape the docs sitemap only.

fabjanvucina commented 5 days ago

This repo already has a sitemap which is included in the sitemap index for our main website.

https://www.daytona.io/sitemap-index.xml

Tpuljak commented 5 days ago

Great. I manually added the sitemap URL to the algolia crawler. I'll close the issue once I confirm that it works.

Tpuljak commented 5 days ago

Looks good.