scraping not progressing

[PJVoorwinden]

I am running this funda scraper in Python Idle and after running it, the script freezes after starting the second phase.

Is this because Funda uses anti-scraping scripts on their website? Or because of something else? Does it still work for you?

Greetings,

Jonathan

[whchien]

Hi Jonathan,

What is the query you were using? I tested it with some samples, and it worked fine.

[vollit]

Got the same issue. I think it is indeed caused by the anti-scraping scripts from Funda.

Edit

I found something strange, when I run the script in a .py file it gives on every query an error, but in a notebook it works fine.

Any idea how?

I tried it on Python 3.10, and 3.9 both same results.

[whchien]

Hi Volit,

What error did you get exactly? I tried with both 3.9 and 3.10, and they seem to be working fine without errors in both .py and notebook environments.

[lisageurten]

Hi there,

I have got almost the same issue. In my first run I retrieve 15 results for an area (only the first funda page). Second run gives me 0 zero results. If I wait some time, I again obtain 15 results and then again the following runs give 0 results again.

I am curious if it still works for you or if you know what might be causing this behavior?

Greetings,

Lisa

[whchien]

Hi @PJVoorwinden @lisageurten

I just updated the new version of funda_scraper. If you can install the latest version (v1.0.0), the scraping should work without problems now. Please let me know if you encounter anything unusual. All the feedback would be appreciated!