search

apache / rocketmq-operator

Apache RocketMQ Operator
https://rocketmq.apache.org/
Apache License 2.0
309 stars 126 forks source link

broker GC log files filling up sandboxes disk space #177

Closed stringang closed 9 months ago

stringang commented 10 months ago

  1. Please describe the issue you observed:

    After the broker has been running for a while, the shm on the host sends out a space-filling alarm.

    the mount point for shm is /data/containerd/state/io.containerd.grpc.v1.cri/sandboxes/4da84135c521f12560742f0739783dea5687503667f81f32a56d9f0f52b0784f/shm.

    going into the shm directory, I found the directory to be the gc log.

  2. Please tell us about your environment:

    • kubernetes: v1.22.15
    • apacherocketmq/rocketmq-broker:4.5.0-alpine-operator-0.3.0
    • containerd: v1.5.0

  3. Other information (e.g. detailed explanation, logs, related issues, suggestions how to fix, etc):

image image image
caigy commented 9 months ago

The default shm-size of docker is ~64MB, but the broker can generate at most 5 GC logs, each consumes 30MB. Workaround may be one of the following:

stringang commented 9 months ago

thanks @caigy