Open orbeckst opened 4 years ago
I am not 100% sure if we need "proove ownership" for "cross submits" as detailed in https://www.sitemaps.org/protocol.html#location, namely our robots.txt
file might need to explicitly list the sitemaps for doc and userguide. Or are these sitemaps ok because they are only accessed from the actual docs.mdanalysis.org/.... url?
According to https://www.sitemaps.org/protocol.html#index
That means we cannot include docs.mdanalysis.org, userguide.mdanalysis.org with www.mdanalysis.org in the sitemapindex.xml.
Apparently, the algolia crawler does not care and still finds them (see https://github.com/algolia/docsearch-configs/issues/2103) but technically this is not legal and we should change it