Sweep: i want to integrate it with selectolax + scrapeghost (✓ Sandbox Passed)

[sweep-ai[bot]]

PR Feedback (click)

• [ ] 👍 Sweep Did Well
• [ ] 👎 Sweep Needs Improvement

  Description

  This pull request integrates the selectolax library with scrapeghost to improve the HTML parsing functionality. It also adds a new script, src/main.py, which utilizes selectolax for initial HTML parsing and then passes the parsed data to scrapeghost for further processing and filtering.

Summary

• Integrated selectolax library with scrapeghost for improved HTML parsing functionality
• Added a new script, src/main.py, that uses selectolax for initial HTML parsing and then passes the parsed data to scrapeghost for processing and filtering
• Updated the README.md and docs/usage.md files to include information about the new src/main.py script and its usage
• Updated the docs/tutorial.md file to reflect the changes in the code examples and their output
• Added new code examples and logs to demonstrate the usage of src/main.py and the improved HTML parsing functionality

Fixes #8.

---

🎉 Latest improvements to Sweep:

• We just released a dashboard to track Sweep's progress on your issue in real-time, showing every stage of the process – from search to planning and coding.
• Sweep uses OpenAI's latest Assistant API to plan code changes and modify code! This is 3x faster and significantly more reliable as it allows Sweep to edit code and validate the changes in tight iterations, the same way as a human would.
• Try using the GitHub issues extension to create Sweep issues directly from your editor! GitHub Issues and Pull Requests.

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

[sweep-ai[bot]]

Sandbox Executions

• [X] Running GitHub Actions for src/main.py ✓

  Check src/main.py with contents:

Ran GitHub Actions for b479c6992cecbd76e38637b37df8ad89c0241e6c:

• [X] Running GitHub Actions for README.md ✓

  Check README.md with contents:

Ran GitHub Actions for 4d064eb7e004ecdbf215ff4a9852c6c9669076a3:

• [X] Running GitHub Actions for docs/tutorial.md ✓

  Check docs/tutorial.md with contents:

Ran GitHub Actions for 59c41f81f0a115c5eab2feab3a6ab65fee6dfc44:

• [X] Running GitHub Actions for docs/usage.md ✓

  Check docs/usage.md with contents:

Ran GitHub Actions for 394bcf397c98cd79f1714d30cdecb6405c9479e8:

[sweep-ai[bot]]

Rollback Files For Sweep

• [ ] Rollback changes to True

[sweep-ai[bot]]

Apply Sweep Rules to your PR?

• [ ] Apply: All new business logic should have corresponding unit tests.
• [ ] Apply: Refactor large functions to be more modular.
• [ ] Apply: Add docstrings to all functions and file headers.