search

internetstandards / Internet.nl

Internet standards compliance test suite
https://internet.nl
171 stars 35 forks source link

Add sitemaps XML #1302

Open bwbroersma opened 5 months ago

bwbroersma commented 5 months ago

Generate a sitemaps XML for the 'static' content like news and FAQ. Probably best with explicit language in the url so both versions are picked up.

Inform crawlers about the sitemaps location in the robots.txt by adding:

Sitemap: https://internet.nl/sitemap.xml

To the current:

https://github.com/internetstandards/Internet.nl/blob/e46a62f55c7263d358aebdcdc7e77b705096b9c0/robots.txt#L1-L6