search

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.17k stars 323 forks source link

Docker ERROR: Could not ping Zookeeper #220

Closed Shique closed 5 years ago

Shique commented 5 years ago

There seems to be an issue both on the dev and master branches - the crawler container keeps failing and restarting with the following message:

ERROR: Could not ping Zookeeper

I've tried this with a fresh copy of the crawler on both Windows and MacOS with the same result.

To replicate - download either branch and issue the command:

docker-compose up -d
Deadly0 commented 5 years ago

@Shique Try image wurstmeister/zookeeper instead of zookeeper. it's works for me

madisonb commented 5 years ago

The wurstmeister image is definitely preferred, not sure why I had it at the default dockerhub zookeeper image, but will change both branches to fix that.

madisonb commented 5 years ago

Fixed on both branches, docker-compose up -d is working.

softwarevamp commented 4 years ago

zookeeper:3.4 works, zookeeper:3.5+ fails.

softwarevamp commented 4 years ago

zookeeper:3.5+ returns envi is not executed because it is not in the whitelist.

softwarevamp commented 4 years ago

-e ZOO_4LW_COMMANDS_WHITELIST="*" fix this.