Improve global page per domain filter documentation.

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

http://scrapy-cluster.readthedocs.io/

MIT License

1.18k stars 323 forks source link

Improve global page per domain filter documentation. #200

Closed devspyrosv closed 5 years ago

devspyrosv commented 6 years ago

This filter is not enabled "cluster wide". Instead it is shared among crawl requests having the same spider and crawlid.

coveralls commented 6 years ago

Coverage remained the same at 70.448% when pulling ed715076514d67f46a0433b4d5166f6afeb30c37 on devspyrosv:improve-docs into bb6e53de48cd075e4519f9cce58aa2bea21588a3 on istresearch:dev.