anmode / grabtern-frontend

Connecting the mentors and creating a network
https://grabtern.in/
MIT License
26 stars 52 forks source link

Generate Sitemap.xml and Robots.txt to improve SEO and Site Crawling #933

Open amiya-cyber opened 1 day ago

amiya-cyber commented 1 day ago

Adding sitemap.xml and robots.txt files helps optimize a website for search engines.

Sitemap.xml provides a list of important URLs, helping search engines discover, crawl, and index new and updated content faster, improving SEO.

Robots.txt controls which parts of the site search engines can access, preventing indexing of sensitive or unimportant pages, conserving crawl budget, and reducing server load.

Together, they enhance site visibility, performance, and search engine ranking.

ASSIGN WITH LEVEL 2 OR LEVEL 3

github-actions[bot] commented 1 day ago

Hello @amiya-cyber! Thank you for raising this issue. Please make sure to follow our Contributing Guidelines. Don't forget to ⭐ our Grabtern-Frontend.

Our review team will carefully assess the issue and reach out to you soon! We appreciate your patience!