Closed banta closed 1 year ago
Hello @banta!
This is a pretty good issue. Do we have a Google Search Console account that could be used to submit the sitemap? We could use it to test the robots.txt
file.
We could use sitemap_generator to set up a dynamic sitemap.
Below are my follow-up questions:
robots.txt
is not a foolproof technical for keeping pages out of search engines, would we want to consider protecting sensitive information in other ways such as authorization and such?Helpful Links
@JudahSan You can review the open pull request #69 and send me feedback.
@AJ-Kulundu, Please focus on addressing the following unresolved issues:
Thank you!
@JudahSan PR #77 should have the necessary changes
The following should be prioritized