Fix Scrape a page on paul grahams website to create a sitemap with stage model

Original issue: #11

What is the feature

The feature involves scraping the page containing links to all of Paul Graham's essays to create a sitemap. This sitemap will be used to render his essays.

Why we need the feature

Creating a sitemap for Paul Graham's essays will allow for easier navigation and rendering of his content on our platform. It will help in organizing the essays systematically and improve the user experience by providing a structured way to access the essays.

How to implement and why

Scrape the Page:
- Use a web scraping library like axios to fetch the HTML content of the page https://paulgraham.com/articles.html.
- Parse the HTML content using a library like cheerio to extract the links to the essays.
Generate Sitemap:
- Create a function to iterate through the extracted links and format them into a sitemap structure (e.g., XML or JSON).
- Ensure that the sitemap includes necessary metadata such as the essay title and URL.
Store and Render:
- Store the generated sitemap in a suitable location within the project (e.g., lib/essays.rss).
- Update the rendering logic in the relevant components (e.g., components/Layouts/PageLayout.tsx) to utilize the sitemap for displaying the essays.
Testing:
- Write unit tests to ensure the scraping and sitemap generation functions work correctly.
- Test the integration to ensure the essays are rendered properly using the sitemap.

By following these steps, we can efficiently scrape the required page, generate a structured sitemap, and enhance the user experience by providing organized access to Paul Graham's essays.

Test these changes locally

git checkout -b stage/issue-#11-12867107-22ff-4287-aef8-d304af4e91a5
git pull origin stage/issue-#11-12867107-22ff-4287-aef8-d304af4e91a5

nikitamalinov / paulgrahamessays