harry-s-grewal / mls-real-estate-scraper-for-realtor.ca

Python MLS and Real-Estate Data Scraper for the Realtor.ca Website
MIT License
56 stars 19 forks source link

403 Client Error: Forbidden for url #11

Open slim-kimmy opened 3 months ago

slim-kimmy commented 3 months ago

Hi I was unable to install it from pip due to it not having a setup.py file so I just ran it from my IDE. This is my error: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nominatim.openstreetmap.org/search?q=Calgary,%20AB&format=json (I am running the example in the readme)

I have run it for the first time, all my versions match, do I need to register for the realtor.ca and get some kind of authorization ? Not sure what to do lol.

Thanks

harry-s-grewal commented 3 months ago

openstreetmap.org is unrelated to realtor.ca. Are you sure you're getting a 403 error for that, and not for realtor.ca? Because that endpoint works when I CURL it directly.

Note, realtor.ca will block IP addresses that ping it more than 3 times for one hour. That is unavoidable and will also cause a 403 client error.

DmacMcgreg commented 2 months ago

Getting 403 having only pinged it once... is this still working for you?