search

flathunters / flathunter

A bot to help people with their rental real-estate search. 🏠🤖
GNU Affero General Public License v3.0
831 stars 179 forks source link

Immowelt is limited to first 4 entries of result list #60

Closed Benedikt1992 closed 2 years ago

Benedikt1992 commented 3 years ago

The crawler of immowelt will only search for matching flats in the first 4 entries of the result list.

All further results are loaded asynchronously on immowelt. The crawler does not load these entries. Usually they would be located in a <div id="listItemWrapperAsync" ... > after loading.

codders commented 3 years ago

Yep. This is a real thing. With the latest changes from @xMordax , we will have Selenium / Chrome Webdriver support in the project, which would make it possible to load those dynamic elements. Maybe you can try again once that's merged.