istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Pass cookies through the distributed scheduler #205

Closed devspyrosv closed 5 years ago

devspyrosv commented 5 years ago

Allow cookies to be passed between requests of the same domain. This was originally possible when using the master branch.

coveralls commented 5 years ago

Coverage Status

Coverage increased (+0.08%) to 70.941% when pulling ee85bc754c2412ebff73c295ff7592a9b6b02cae on devspyrosv:patch-1 into 7e1e4971e9716f18836ea34d5c363d5fb6d6c3d0 on istresearch:dev.