Update robots.txt, add ROBOTS_DISALLOWED and extra-robots.txt

CanastaWiki / Canasta

MediaWiki Docker image for Canasta, an all-in-one MediaWiki stack for easy deployment and management of enterprise-ready MediaWiki on production environments.

https://www.canasta.wiki

MIT License

38 stars 28 forks source link

Update robots.txt, add ROBOTS_DISALLOWED and extra-robots.txt #426

Closed naresh-kumar-babu closed 3 months ago