search

kubernetes-retired / contrib

[EOL] This is a place for various components in the Kubernetes ecosystem that aren't part of the Kubernetes core.
Apache License 2.0
2.46k stars 1.68k forks source link

Zookeeper: Auto purge task is not starting #2942

Closed arunpjohny closed 6 years ago

arunpjohny commented 6 years ago

Even after setting the ZK_PURGE_INTERVAL environment variable, the auto purge task to remove older snapshots and logs is not getting started leading to out of disk errors.

Zookeeper startup logs

  • zkGenConfig.sh Validating environment ... ZK_PURGE_INTERVAL=1 ENSEMBLE ... Environment validation successful Creating ZooKeeper configuration Wrote ZooKeeper configuration file to /opt/zookeeper/conf/zoo.cfg Creating ZooKeeper log4j configuration Wrote log4j configuration to /opt/zookeeper/conf/log4j.properties Creating ZooKeeper data directories and setting permissions Created ZooKeeper data directories and set permissions in /var/lib/zookeeper/data Creating JVM configuration file Wrote JVM configuration to /opt/zookeeper/conf/java.env
  • exec zkServer.sh start-foreground ZooKeeper JMX enabled by default ZooKeeper remote JMX Port set to 1099 ZooKeeper remote JMX authenticate set to false ZooKeeper remote JMX ssl set to false ZooKeeper remote JMX log4j set to true Using config: /usr/bin/../etc/zookeeper/zoo.cfg 2018-08-30 16:13:36,321 [myid:] - INFO [main:QuorumPeerConfig@134] - Reading configuration from: /usr/bin/../etc/zookeeper/zoo.cfg 2018-08-30 16:13:41,352 [myid:] - INFO [main:QuorumPeer$QuorumServer@167] - Resolved hostname: gt-zk-zookeeper-2.gt-zk-zookeeper-headless.common.svc.cluster.local to address: gt-zk-zookeeper-2.gt-zk-zookeeper-headless.common.svc.cluster.local/100.120.0.11 2018-08-30 16:13:41,354 [myid:] - INFO [main:QuorumPeer$QuorumServer@167] - Resolved hostname: gt-zk-zookeeper-1.gt-zk-zookeeper-headless.common.svc.cluster.local to address: gt-zk-zookeeper-1.gt-zk-zookeeper-headless.common.svc.cluster.local/100.115.0.8 2018-08-30 16:13:41,362 [myid:] - INFO [main:QuorumPeer$QuorumServer@167] - Resolved hostname: gt-zk-zookeeper-0.gt-zk-zookeeper-headless.common.svc.cluster.local to address: gt-zk-zookeeper-0.gt-zk-zookeeper-headless.common.svc.cluster.local/100.123.128.7 2018-08-30 16:13:41,363 [myid:] - INFO [main:QuorumPeerConfig@396] - Defaulting to majority quorums 2018-08-30 16:13:41,371 [myid:1] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2018-08-30 16:13:41,372 [myid:1] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2018-08-30 16:13:41,372 [myid:1] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.