flathunters / flathunter

A bot to help people with their rental real-estate search. 🏠🤖
GNU Affero General Public License v3.0
831 stars 179 forks source link

Issue - Initializing Chrome WebDriver for crawler "CrawlImmobilienscout" #227

Closed Tydnl closed 1 year ago

Tydnl commented 1 year ago

Hi guys, I'm facing a problem when it comes to crawling Immoscout24. Everything in the config is usually set up correctly but it seems something with the chromedriver is broken.

Here you can see the full issue that I'm facing within the terminal:

Bildschirmfoto 2022-09-21 um 16 47 00

Looking forward to get some help here.

Thank you in advance!

codders commented 1 year ago

Hi @Tydnl ,

Was that issue persistent - do you still have the problem? Looking quickly at google, this looks like it might be a temporary certificate configuration problem on the ImmoScout side, or some other problem with your connection.

Tydnl commented 1 year ago

HI @codders,

Thank you for your response.

Unfortunately, I'm still facing the exact same problem as described above. I've tried different connections and its the same everywhere. Once I kick ImmoScout out of the config everything works properly.

codders commented 1 year ago

@Tydnl Can you try the steps here: https://github.com/ultrafunkamsterdam/undetected-chromedriver/issues/122

It seems like other users have a similar issue, and it could be related to your python installation.

Tydnl commented 1 year ago

@codders Thanks for letting me know. Unfortunately, the solution in your mentioned thread solved the problem on linux, I guess but I'm running the script via the terminal on my mac which is still not working so far. I'm searching further.

Tydnl commented 1 year ago

Problem solved: OSX had no certificates to validate SSL connections

For all of you facing the same problem, have a look at the following thread which helped me to solve the issue: https://stackoverflow.com/questions/27835619/urllib-and-ssl-certificate-verify-failed-error

codders commented 1 year ago

Awesome - thanks so much for the reseach!