search

scrapinghub / frontera

A scalable frontier for web crawlers
BSD 3-Clause "New" or "Revised" License
1.29k stars 215 forks source link

ModuleNotFoundError: No module named 'frontera.contrib.scrapy.middlewares.recording' #400

Open gesof opened 4 years ago

gesof commented 4 years ago

According to Activating the recorder in the official/latest docs one has to enable recording by using CrawlRecorderSpiderMiddleware and CrawlRecorderDownloaderMiddleware middlewares which does not exist anymore.

There is however a setting in the example which has no documentation in the docs: SCHEDULER = 'frontera.contrib.scrapy.schedulers.recording.RecorderScheduler'

sibiryakov commented 4 years ago

Yeah, @gesof it needs to be dropped from docs.