search

rorymcd98 / rightmove-scraper

Scrapes rightmove
Mozilla Public License 2.0
1 stars 1 forks source link

Zoopla #2

Open scotthooker opened 2 months ago

scotthooker commented 2 months ago

Hey! Pinged you a DM on LinkedIn, wanted to ask if there's anything I can help with on the Zoopla side of things. But not sure where best to / how best to contribute.

rorymcd98 commented 2 months ago

@scotthooker Hey I seem to have zoopla scraping working again in master. It seemed to be 403'ing against Zoopla's cloudflare protection.

I bumped the package crawlee/apify package and it's able to get around cloudflare for now.

In terms of data collection, my perosnal high prio is making sure the basics work: price, nearest stations, roomsize. But if there's anything that isn't working to your liking (I noticed 'tenure' is not found 90% of the time) then feel free to adress this.