search

yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters
Apache License 2.0
11.81k stars 2.5k forks source link

I am trying to make a cluster with 3 kafka and 3 broker. Kafka is running and up but when trying to start broker I am getting this error - Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer). Using confluent kafka 5.1 trail version. #613

Open deepak2kc opened 5 years ago

deepak2kc commented 5 years ago

Command used to start broker: [root@server1 kafka]# /opt/confluent-5.1/confluent-5.1.0/bin/kafka-server-start /opt/confluent-5.1/confluent-5.1.0/etc/kafka/server.properties

Response after running command: [2019-02-12 21:02:09,313] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [2019-02-12 21:02:09,551] INFO KafkaConfig values: advertised.host.name = null advertised.listeners = null advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = -1 broker.id.generation.enable = true broker.interceptor.class = class org.apache.kafka.server.interceptor.DefaultBrokerInterceptor broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 0 group.max.session.timeout.ms = 300000 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = null inter.broker.protocol.version = 2.1-IV2 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL listeners = null log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /tmp/kafka-logs log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.1-IV2 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [GSSAPI] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = xx.xx.xx.26:2181,xx.xx.xx.199:2181,xx.xx.xx.156:2181 zookeeper.connection.timeout.ms = 16000 zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [2019-02-12 21:02:09,632] WARN Please note that the support metrics collection feature ("Metrics") of Proactive Support is enabled. With Metrics enabled, this broker is configured to collect and report certain broker and cluster metadata ("Metadata") about your use of the Confluent Platform (including without limitation, your remote internet protocol address) to Confluent, Inc. ("Confluent") or its parent, subsidiaries, affiliates or service providers every 24hours. This Metadata may be transferred to any country in which Confluent maintains facilities. For a more in depth discussion of how Confluent processes such information, please read our Privacy Policy located at http://www.confluent.io/privacy. By proceeding with confluent.support.metrics.enable=true, you agree to all such collection, transfer, storage and use of Metadata by Confluent. You can turn the Metrics feature off by setting confluent.support.metrics.enable=false in the broker configuration and restarting the broker. See the Confluent Platform documentation for further information. (io.confluent.support.metrics.SupportedServerStartable) [2019-02-12 21:02:09,634] INFO starting (kafka.server.KafkaServer) [2019-02-12 21:02:09,635] INFO Connecting to zookeeper on xx.xx.xx.26:2181,xx.xx.xx.199:2181,xx.xx.xx.156:2181 (kafka.server.KafkaServer) [2019-02-12 21:02:09,649] INFO [ZooKeeperClient] Initializing a new session to xx.xx.xx.26:2181,xx.xx.xx.199:2181,xx.xx.xx.156:2181. (kafka.zookeeper.ZooKeeperClient) [2019-02-12 21:02:09,653] INFO Client environment:zookeeper.version=3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03, built on 06/29/2018 00:39 GMT (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,653] INFO Client environment:host.name=server1.swift.corp (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,653] INFO Client environment:java.version=1.8.0_151 (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,653] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,653] INFO Client environment:java.home=/usr/lib/jvm/java-1.8.0-oracle-1.8.0.151-1jpp.5.el7.x86_64/jre (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,653] INFO Client environment:java.class.path=/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1-sources.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-jaxrs-json-provider-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1-scaladoc.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.inject-1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-streams-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1-javadoc.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/confluent-metrics-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-client-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-transforms-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/zstd-jni-1.3.5-4.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-core-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/zookeeper-3.4.13.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-tools-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-http-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-log4j-appender-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/maven-artifact-3.5.4.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/validation-api-1.1.0.Final.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-logging-1.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/audience-annotations-0.5.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/lz4-java-1.5.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/guava-20.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-runtime-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-client-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-util-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.servlet-api-3.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-validator-1.4.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-streams-test-utils-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/common-utils-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-collections-3.2.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javassist-3.22.0-CR2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-clients-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/support-metrics-common-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/httpclient-4.5.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/metrics-core-2.2.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/hk2-utils-2.5.0-b42.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-api-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/avro-1.8.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/hk2-locator-2.5.0-b42.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-databind-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-streams-scala_2.11-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-module-jaxb-annotations-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/log4j-1.2.17.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1-test.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/netty-3.10.6.Final.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/snappy-java-1.1.7.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-continuation-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-lang3-3.5.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/scala-library-2.11.12.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-container-servlet-core-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/rocksdbjni-5.14.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/hk2-api-2.5.0-b42.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/aopalliance-repackaged-2.5.0-b42.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.annotation-api-1.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-container-servlet-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-common-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-media-jaxb-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-basic-auth-extension-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/plexus-utils-3.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-core-asl-1.9.13.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/slf4j-api-1.7.25.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-hk2-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/xz-1.5.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-compress-1.8.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jline-0.9.94.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jersey-server-2.27.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.ws.rs-api-2.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-codec-1.9.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-security-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/activation-1.1.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-lang3-3.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jaxb-api-2.3.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/httpcore-4.4.4.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jopt-simple-5.0.4.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/slf4j-log4j12-1.7.25.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-io-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/paranamer-2.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-annotations-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/reflections-0.9.11.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-servlets-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/scala-logging_2.11-3.9.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/osgi-resource-locator-1.0.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/ldap-plugins-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-servlet-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.ws.rs-api-2.1.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/javax.inject-2.5.0-b42.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-jaxrs-base-2.9.7.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/httpmime-4.5.2.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-json-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka_2.11-2.1.0-cp1-test-sources.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jetty-server-9.4.12.v20180830.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/connect-file-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/support-metrics-client-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka-streams-examples-2.1.0-cp1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/kafka.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/jackson-mapper-asl-1.9.13.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/zkclient-0.10.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/scala-reflect-2.11.12.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-beanutils-1.8.3.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/argparse4j-0.7.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/kafka/commons-digester-1.8.1.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/zookeeper-3.4.13.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/audience-annotations-0.5.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/support-metrics-fullcollector-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/common-utils-5.1.0.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/netty-3.10.6.Final.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/slf4j-api-1.7.25.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/jline-0.9.94.jar:/opt/confluent-5.1/confluent-5.1.0/bin/../share/java/confluent-support-metrics/zkclient-0.10.jar:/usr/share/java/confluent-support-metrics/* (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:os.version=3.10.0-862.3.3.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,654] INFO Client environment:user.dir=/opt/confluent-5.1/confluent-5.1.0/etc/kafka (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,655] INFO Initiating client connection, connectString=xx.xx.xx.26:2181,xx.xx.xx.199:2181,xx.xx.xx.156:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@1a677343 (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:09,665] INFO [ZooKeeperClient] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [2019-02-12 21:02:09,669] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:09,673] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:09,675] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,345] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,346] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,348] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,863] INFO Opening socket connection to server xx.xx.xx.26/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,863] INFO Socket connection established to xx.xx.xx.26/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:10,864] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,309] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,310] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,313] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,572] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,573] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,574] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,983] INFO Opening socket connection to server marx5020.swift.com/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,984] INFO Socket connection established to marx5020.swift.com/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:12,984] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:14,533] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:14,533] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:14,534] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,043] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,044] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,044] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,706] INFO Opening socket connection to server xx.xx.xx.26/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,706] INFO Socket connection established to xx.xx.xx.26/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:15,707] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:17,354] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:17,355] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:17,355] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,073] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,073] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,074] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,219] INFO Opening socket connection to server marx5020.swift.com/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,220] INFO Socket connection established to marx5020.swift.com/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:18,221] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:19,368] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:19,369] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:19,369] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,030] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,030] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,031] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,635] INFO Opening socket connection to server xx.xx.xx.26/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,636] INFO Socket connection established to xx.xx.xx.26/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:20,636] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,477] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,478] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,478] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,721] INFO Opening socket connection to server server3/xx.xx.xx.156:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,721] INFO Socket connection established to server3/xx.xx.xx.156:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:22,722] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:23,310] INFO Opening socket connection to server marx5020.swift.com/xx.xx.xx.26:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:23,310] INFO Socket connection established to marx5020.swift.com/xx.xx.xx.26:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:23,311] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:25,148] INFO Opening socket connection to server server2/xx.xx.xx.199:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:25,149] INFO Socket connection established to server2/xx.xx.xx.199:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:25,149] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:25,667] INFO [ZooKeeperClient] Closing. (kafka.zookeeper.ZooKeeperClient) [2019-02-12 21:02:25,966] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper) [2019-02-12 21:02:25,967] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn) [2019-02-12 21:02:25,967] INFO [ZooKeeperClient] Closed. (kafka.zookeeper.ZooKeeperClient) [2019-02-12 21:02:25,970] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply$mcV$sp(ZooKeeperClient.scala:268) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:264) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:264) at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251) at kafka.zookeeper.ZooKeeperClient.kafka$zookeeper$ZooKeeperClient$$waitUntilConnected(ZooKeeperClient.scala:264) at kafka.zookeeper.ZooKeeperClient.(ZooKeeperClient.scala:97) at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1693) at kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:348) at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:372) at kafka.server.KafkaServer.startup(KafkaServer.scala:202) at io.confluent.support.metrics.SupportedServerStartable.startup(SupportedServerStartable.java:114) at io.confluent.support.metrics.SupportedKafka.main(SupportedKafka.java:66) [2019-02-12 21:02:25,972] INFO shutting down (kafka.server.KafkaServer) [2019-02-12 21:02:25,976] INFO shut down completed (kafka.server.KafkaServer) [2019-02-12 21:02:25,976] INFO Shutting down SupportedServerStartable (io.confluent.support.metrics.SupportedServerStartable) [2019-02-12 21:02:25,976] INFO Closing BaseMetricsReporter (io.confluent.support.metrics.BaseMetricsReporter) [2019-02-12 21:02:25,977] INFO Waiting for metrics thread to exit (io.confluent.support.metrics.SupportedServerStartable) [2019-02-12 21:02:25,977] INFO Shutting down KafkaServer (io.confluent.support.metrics.SupportedServerStartable) [2019-02-12 21:02:25,977] INFO shutting down (kafka.server.KafkaServer)

montana-ua commented 5 years ago

Why do you think it's related to kafka manager? You Kafka Broker can't connect to your Zookeeper.