rmax / scrapy-redis

Redis-based components for Scrapy.
http://scrapy-redis.readthedocs.io
MIT License
5.54k stars 1.59k forks source link

fix: Scheduler not compatible with BaseDupeFilter #294

Closed HairlessVillager closed 4 months ago

HairlessVillager commented 5 months ago

Description

Fixes #293

API change: add dupefilter=None argument in Scheduler.__init__().

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

Test Configuration:

Checklist: