search

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.17k stars 323 forks source link

online integration test error #224

Closed rawiafray closed 4 years ago

rawiafray commented 5 years ago

I'm trying to run the online integration test , i get this error : test_feed (main.TestKafkaMonitor) ... 2019-07-17 17:14:45,413 [kafka-monitor] ERROR: Failed to connect to Redis in ActionHandler ERROR test_run (main.TestKafkaMonitor) ... 2019-07-17 17:14:45,536 [kafka-monitor] ERROR: Failed to connect to Redis in ActionHandler ERROR

====================================================================== ERROR: test_feed (main.TestKafkaMonitor)

Traceback (most recent call last): File "tests/online.py", line 56, in setUp self.kafka_monitor._load_plugins() File "/home/databiz40/scrapy-cluster/kafka-monitor/kafka_monitor.py", line 79, in _load_plugins instance.setup(self.settings) File "/home/databiz40/scrapy-cluster/kafka-monitor/plugins/action_handler.py", line 28, in setup sys.exit(1) SystemExit: 1

====================================================================== ERROR: test_run (main.TestKafkaMonitor)

Traceback (most recent call last): File "tests/online.py", line 56, in setUp self.kafka_monitor._load_plugins() File "/home/databiz40/scrapy-cluster/kafka-monitor/kafka_monitor.py", line 79, in _load_plugins instance.setup(self.settings) File "/home/databiz40/scrapy-cluster/kafka-monitor/plugins/action_handler.py", line 28, in setup sys.exit(1) SystemExit: 1

Ran 2 tests in 0.242s

FAILED (errors=2)

madisonb commented 5 years ago

I would double check you have your redis settings correct, and your redis instance cli is accessible if you try to connect to it.

madisonb commented 4 years ago

Closing due to inactivity.