wurstmeister / kafka-docker

Dockerfile for Apache Kafka
http://wurstmeister.github.io/kafka-docker/
Apache License 2.0
6.89k stars 2.73k forks source link

The volume of kafka is big #719

Closed huwentao1 closed 1 year ago

huwentao1 commented 1 year ago

this is my kakfa volume size

image

this is my docker-compose file,

version: "3.1"
services:
  zoo1:
    image: zookeeper:3.4.13
    restart: always
    hostname: zoo1
    container_name: zk1
    ports:
      - 2181:2181
    volumes:
      - /xxx/kfk/zookeeper/zoo1/data:/data
      - /xxx/kfk/zookeeper/zoo1/datalog:/datalog
  kfk1:
    image: wurstmeister/kafka:2.11-0.10.2.1
    restart: always
    hostname: kfk1
    container_name: kfk1
    ports:
      - "9091:9091"
    depends_on:
      - zoo1
    environment:
      KAFKA_HEAP_OPTS: "-Xmx4G -Xms4G"
      KAFKA_BROKER_ID: 1
      KAFKA_MESSAGE_MAX_BYTES: 60000000
      KAFKA_OREPLICA_FETCH_MAX_BYTES: 80000000
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_ZOOKEEPER_CONNECT: zoo1:2181
      KAFKA_LISTENERS: PLAINTEXT://:9091
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://x.x.x.x:9091
    volumes:
      - /xxx/kfk/kafka/docker.sock:/var/run/docker.sock

I read in the document that messages will be deleted by default after 7 days, so I don't know why my volume is getting bigger and bigger

OneCricketeer commented 1 year ago

You've not mounted Kafka container data to your host, so what command are you showing output for?

Also, Kafka can hold data for more than 7 days