Open jeroenvermunt opened 2 years ago
When running the code after forking, I immediately got the following error:
AttributeError: 'FundaSpider' object has no attribute '_rules'
I solved it by adding the following line to init():
super(FundaSoldSpider, self).__init__(place=place)
The error stopped appearing, but now the following lines show up during scraping, giving an empty json file in the end.
[scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.funda.nl/koop/verkocht/eindhoven/p259/> (referer: None) [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://www.funda.nl/koop/verkocht/eindhoven/p268/> from <GET http://www.funda.nl/koop/verkocht/eindhoven/p268/>
there are the following possibilities:
I'm am not sure which one it is, anyone have any idea on how to get the scraper to work?
This fixes those problems + some others that prevent it from working, just in case you didn't figure it out yet! (only changes for the currently for-sale houses, not the sold ones)
When running the code after forking, I immediately got the following error:
AttributeError: 'FundaSpider' object has no attribute '_rules'
I solved it by adding the following line to init():
super(FundaSoldSpider, self).__init__(place=place)
The error stopped appearing, but now the following lines show up during scraping, giving an empty json file in the end.
there are the following possibilities:
I'm am not sure which one it is, anyone have any idea on how to get the scraper to work?