istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Fix spider name in crawler's online tests #161

Closed devspyrosv closed 6 years ago

devspyrosv commented 6 years ago

Because of the wrong spider name, a wrong redis directory ended up containing the queue key. This way the spider was not crawling the provided link.

coveralls commented 6 years ago

Coverage Status

Coverage remained the same at 65.908% when pulling 7edca88b6dd2312661553db7464d7af984f2eaba on devspyrosv:devspyrosv-crawler-tests into 61d8809e5bc08596c7f96234998da4173fceb182 on istresearch:dev.