Error processing /etc/kafka/zookeeper.properties.scale-5.pzoo-1

[jaeyj2]

There is the same issue here, but it has been closed and has been reposted. I followed the guide, and I got to the Pod's starting state normally. However, the pod status fails.

NAME READY STATUS RESTARTS AGE kafka-0 0/1 CrashLoopBackOff 45 3h35m kafka-1 0/1 CrashLoopBackOff 45 3h35m kafka-2 0/1 CrashLoopBackOff 45 3h35m pzoo-0 0/1 CrashLoopBackOff 10 28m pzoo-1 0/1 CrashLoopBackOff 10 28m pzoo-2 0/1 CrashLoopBackOff 10 28m zoo-0 0/1 CrashLoopBackOff 10 28m zoo-1 0/1 CrashLoopBackOff 10 28m

The pod log. [root@pstest01 kafka2]# kubectl logs pzoo-1 -n kafka2 [2020-10-30 08:41:02,645] INFO Reading configuration from: /etc/kafka/zookeeper.properties.scale-5.pzoo-1 (org.apache.zookeeper.server.quorum.QuorumPeerConfig) [2020-10-30 08:41:02,647] ERROR Invalid config, exiting abnormally (org.apache.zookeeper.server.quorum.QuorumPeerMain) org.apache.zookeeper.server.quorum.QuorumPeerConfig$ConfigException: Error processing /etc/kafka/zookeeper.properties.scale-5.pzoo-1 at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:156) at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:113) at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82) Caused by: java.lang.IllegalArgumentException: /etc/kafka/zookeeper.properties.scale-5.pzoo-1 file is missing at org.apache.zookeeper.server.util.VerifyingFileFactory.doFailForNonExistingPath(VerifyingFileFactory.java:51) at org.apache.zookeeper.server.util.VerifyingFileFactory.validate(VerifyingFileFactory.java:45) at org.apache.zookeeper.server.util.VerifyingFileFactory.create(VerifyingFileFactory.java:40) at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:141) ... 2 more

It seems that we need to modify the zookeeper.properties related part of configmap. But I don't know which of the many lines is the problem. Because the log only came out missing files.

zookeeper-config.yml was applied as it is.

[jaeyj2]

/etc/kafka/zookeeper.properties.scale-5.pzoo-1 org.apache.zookeeper.server.util.VerifyingFileFactory.doFailForNonExistingPath

I don't know why zookeeper.properties is not getting this file from log.

[uluzox]

I am having the same issue

The logs of the init-config container of zoo-1 Pod are:

+ '[' '!' -d /var/lib/zookeeper/data ']'
+ '[' -z 4 ']'
+ export ZOOKEEPER_SERVER_ID=5
+ ZOOKEEPER_SERVER_ID=5
+ echo 5
+ tee /var/lib/zookeeper/data/myid
5
+ cp -Lur /etc/kafka-configmap/init.sh /etc/kafka-configmap/log4j.properties /etc/kafka-configmap/zookeeper.properties /etc/kafka/
+ '[' '!' -z '' ']'
+ ln -s /etc/kafka/zookeeper.properties /etc/kafka/zookeeper.properties.scale-.zoo-1

From 10zookeeper-config.yml $REPLICAS does not seem to be get set...

ln -s /etc/kafka/zookeeper.properties /etc/kafka/zookeeper.properties.scale-$REPLICAS.$POD_NAME

Im running on k3s and rancher

[jaeyj2]

C:\Users\jae\Downloads\111\kafka_2.11-2.4.0\kafka_2.11-2.4.0\bin C:\Users\jae\Downloads\111\kafka_2.11-2.4.0\kafka_2.11-2.4.0\config

kafka2.4.1's directory is bin and config.
but this configmap targeting is /etc/kafka.

Maybe this need to fix real directory

What is the real path of the docker image's config and bin directory?

[uluzox]

Changing ln -s /etc/kafka/zookeeper.properties /etc/kafka/zookeeper.properties.scale-$REPLICAS.$POD_NAME to ln -s /etc/kafka/zookeeper.properties /etc/kafka/zookeeper.properties.scale-5.$POD_NAME in 10zookeeper-config.yml seems to have solved the issue... I did this because both 51zoo.yml and 50pzoo.yml run this command:

command:
        - ./bin/zookeeper-server-start.sh
        - /etc/kafka/zookeeper.properties.scale-5.$(POD_NAME)

However this is not a real solution, is it?

[jaeyj2]

After zookeeper-config.yml modification, it was started normally. Thank you.