rmax / scrapy-redis

Redis-based components for Scrapy.
http://scrapy-redis.readthedocs.io
MIT License
5.49k stars 1.59k forks source link

fix: Scheduler not compatible with BaseDupeFilter #294

Closed HairlessVillager closed 1 day ago

HairlessVillager commented 2 weeks ago

Description

Fixes #293

API change: add dupefilter=None argument in Scheduler.__init__().

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

Test Configuration:

Checklist: