Burton/robots sitemap in robots.txt - Githubissues

hicommonwealth / commonwealth

A platform for decentralized communities

https://commonwealth.im

GNU General Public License v3.0

65 stars 38 forks source link

Burton/robots sitemap in robots.txt #7594

Closed burtonator closed 1 week ago

burtonator commented 2 weeks ago

Link to Issue

Closes: https://github.com/hicommonwealth/commonwealth/issues/7448

Description of Changes

Gives us a robots.txt and links to our sitemap file in AWS

"How We Fixed It"

Test Plan

I did a curl on localhost:8080/robots.txt which worked.
Now we have to push this into prod and verify it is served there properly.

Deployment Plan

Other Considerations