search

digital-engineering / airbnb-scraper

Airbnb Scraper: Advanced Airbnb Search using Scrapy
GNU General Public License v3.0
192 stars 66 forks source link

How to scrap data directly with listing id, instead of searching? #18

Closed zding1016 closed 2 years ago

zding1016 commented 2 years ago

Hi,

Your code is impressive, but now I have already get the listing ids, so there is no need to do the searching step. I tried to modify the code but I failed. Can anyone provide some hints & suggestions? Thanks!

digitalengineering commented 2 years ago

Thanks! I don't think there is a way to do what you want currently. This project is based on scrapy, which is designed specifically for web scraping. It would probably be easier to create a new script using requests.

Once you get the response, you can look at AirbnbSpider.parse() in deepbnb/spiders/airbnb.py to see how to extract data from the response.