Zookeeper

[physikerwelt]

Hi, it seems as the Zookeeper ToDo has been solved. Zookeeper is being installed automatically but not configured. Can we add a little bit of documentation concerning this aspect to the README.MD If I try to start zookeeper manually I get: zookeeper-server initialize JMX enabled by default Using config: /etc/zookeeper/conf/zoo.cfg ZooKeeper data directory is missing at /var/lib/zookeeper fix the path or run initialize

[physikerwelt]

PS: I tried to use the linked zookeeper module but I get: The following packages have unmet dependencies: zookeeperd : Depends: zookeeper (= 3.3.5+dfsg1-1ubuntu1) but 3.4.5+20-1.cdh4.3.1.p0.76~precise-cdh4.3.1 is to be installed E: Unable to correct problems, you have held broken packages.

[ottomata]

Oo, I need to update the README and remove mention of Zookeeper support.

Can you do:

apt-get purge zookeeper zookeeper-server apt-get install zookeeperd?

[physikerwelt]

This leads to the problem mentioned above:

Attached my log: vagrant@dopa-vm:~$ sudo apt-get purge zookeeper zookeeper-server Reading package lists... Done Building dependency tree Reading state information... Done The following packages were automatically installed and are no longer required: libopts25 ntp bigtop-jsvc Use 'apt-get autoremove' to remove them. The following packages will be REMOVED: hadoop* hadoop-0.20-mapreduce* hadoop-client* hadoop-hdfs* hadoop-hdfs-datanode hadoop-hdfs-namenode* hadoop-mapreduce* hadoop-mapreduce-historyserver hadoop-yarn* hadoop-yarn-nodemanager* hadoop-yarn-resourcemanager* hbase hbase-master* hbase-regionserver* zookeeper* zookeeper-server 0 upgraded, 0 newly installed, 16 to remove and 6 not upgraded. After this operation, 152 MB disk space will be freed. Do you want to continue [Y/n]? Y (Reading database ... 68169 files and directories currently installed.) Removing hadoop-yarn-resourcemanager ...

• Stopping Hadoop resourcemanager: stopping resourcemanager Purging configuration files for hadoop-yarn-resourcemanager ... Removing hadoop-yarn-nodemanager ...
• Stopping Hadoop nodemanager: stopping nodemanager Purging configuration files for hadoop-yarn-nodemanager ... Removing hadoop-mapreduce-historyserver ...
• Stopping Hadoop historyserver: stopping historyserver Purging configuration files for hadoop-mapreduce-historyserver ... Removing hadoop-client ... Removing hadoop-mapreduce ... Purging configuration files for hadoop-mapreduce ... dpkg: warning: while removing hadoop-mapreduce, directory '/var/log/hadoop-mapreduce' not empty so not removed. Removing hadoop-yarn ... Purging configuration files for hadoop-yarn ... dpkg: warning: while removing hadoop-yarn, directory '/var/log/hadoop-yarn' not empty so not removed. Removing hbase-regionserver ... Purging configuration files for hbase-regionserver ... Removing hbase-master ... Purging configuration files for hbase-master ... Removing hbase ... Purging configuration files for hbase ... dpkg: warning: while removing hbase, directory '/var/run/hbase' not empty so not removed. dpkg: warning: while removing hbase, directory '/var/log/hbase' not empty so not removed. Removing hadoop-hdfs-namenode ...
• Stopping Hadoop namenode: stopping namenode Purging configuration files for hadoop-hdfs-namenode ... Removing hadoop-hdfs-datanode ...
• Stopping Hadoop datanode: stopping datanode Purging configuration files for hadoop-hdfs-datanode ... Removing hadoop-0.20-mapreduce ... Purging configuration files for hadoop-0.20-mapreduce ... Removing hadoop-hdfs ... Purging configuration files for hadoop-hdfs ... dpkg: warning: while removing hadoop-hdfs, directory '/var/lib/hadoop-hdfs' not empty so not removed. dpkg: warning: while removing hadoop-hdfs, directory '/var/log/hadoop-hdfs' not empty so not removed. Removing hadoop ... Purging configuration files for hadoop ... dpkg: warning: while removing hadoop, directory '/etc/hadoop/conf.empty' not empty so not removed. Removing zookeeper-server ... JMX enabled by default Using config: /etc/zookeeper/conf/zoo.cfg Stopping zookeeper ... STOPPED Purging configuration files for zookeeper-server ... Removing zookeeper ... Purging configuration files for zookeeper ... dpkg: warning: while removing zookeeper, directory '/var/log/zookeeper' not empty so not removed. Processing triggers for ureadahead ... Processing triggers for man-db ... Processing triggers for libc-bin ... ldconfig deferred processing now taking place

vagrant@dopa-vm:~$ sudo apt-get install zookeeperd Reading package lists... Done Building dependency tree Reading state information... Done Some packages could not be installed. This may mean that you have requested an impossible situation or if you are using the unstable distribution that some required packages have not yet been created or been moved out of Incoming. The following information may help to resolve the situation:

The following packages have unmet dependencies: zookeeperd : Depends: zookeeper (= 3.3.5+dfsg1-1ubuntu1) but 3.4.5+20-1.cdh4.3.1.p0.76~precise-cdh4.3.1 is to be installed E: Unable to correct problems, you have held broken packages.

[ottomata]

Oh oh oh, you are right, sorry. We do not install zookeeper on our Hadoop nodes, so we don't have the same conflict you have here :(