crawler for immowelt is grabbing to much

[qudiqudi]

Describe the bug immowelt shows listings outside the filter criteria below the matched listings. Seperated by an info line:

Fredy, grabs these listings below that line as potential findings for the assigned job, which is incorrect. It's mostly outside the defined search radius.

Looks like it should stop at the alertBoxSeparator div class:

[orangecoding]

Immowelt is fucked up in general. Their source code is horribly broken at significant places. Whoever is maintains their websites, I often times thought their only purpose in life is giving me headaches ;)

I'll see what I can do..

[orangecoding]

Hey @qudiqudi my latest change should mitigate the issue. Plz check it out, but be aware of the breaking change (See Release Notes)

If it works, please close the issue

[qudiqudi]

Unfortunately, it still grabs listings below the divider.

And it looks like they A/B testing the website layout, yesterday it looked different.

[orangecoding]

This is the reason why I said they are fucked up. They change their source with every internal build. Bad for the user (caching) but even worst for us

[orangecoding]

Im on vacation now. Will check afterwards. Maybe it has settled by then... ;)

[qudiqudi]

Fredy is still ignoring the "Weitere Ergebnisse" divider with immowelt.

[orangecoding]

Yeah. I'm currently busy with family related stuff. As soon as I can I will jump on it. But how about you give it a shot yourself and create a pr? ;)

[orangecoding]

@qudiqudi That does fix the issue. https://github.com/orangecoding/fredy/commit/6d2ab5f9581cd689446501304c0cdbcd803b72a3

Next time a pr would be nice. Thanks ;)