Sweep: i want to enhance this scrapy web scraping features (✓ Sandbox Passed)

[sweep-ai[bot]]

PR Feedback (click)

• [ ] 👍 Sweep Did Well
• [ ] 👎 Sweep Needs Improvement

  Description

  This pull request includes changes to the livablproject package and livablproject/spiders and livablproject/utils directories. It introduces consistent snake_case naming conventions for field names in the LivablprojectItem class in items.py. It also adds a new format_scraped_data function to the json_utils.py file.

Summary

• Updated field names in LivablprojectItem class in items.py:
  • projecturl changed to project_url
  • buildingType changed to building_type
  • unitsStories changed to units_stories
  • sizeSqFt changed to size_sq_ft
  • estimatedCompletion changed to estimated_completion
  • galleryData changed to gallery_data
  • hd_development_latitude remains unchanged
• Added format_scraped_data function to json_utils.py in livablproject/utils directory
• Updated livabl.py and livabl_sitemap.py in livablproject/spiders directory to use format_scraped_data function before yielding the scraped data

Fixes #1.

---

🎉 Latest improvements to Sweep:

• New dashboard launched for real-time tracking of Sweep issues, covering all stages from search to coding.
• Integration of OpenAI's latest Assistant API for more efficient and reliable code planning and editing, improving speed by 3x.
• Use the GitHub issues extension for creating Sweep issues directly from your editor.

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

[sweep-ai[bot]]

Rollback Files For Sweep

• [ ] Rollback changes to livablproject/spiders/livabl.py
• [ ] Rollback changes to livablproject/spiders/livabl_sitemap.py
• [ ] Rollback changes to livablproject/items.py
• [ ] Rollback changes to livablproject/utils/json_utils.py

This is an automated message generated by Sweep AI.