search

apache / druid

Apache Druid: a high performance real-time analytics database.
https://druid.apache.org/
Apache License 2.0
13.37k stars 3.67k forks source link

Auto-compaction tasks are not submitted when single compact task runs for longtime #16693

Open sachidananda007 opened 1 month ago

sachidananda007 commented 1 month ago

Druid is on 25.0.0 running on kubernetes.

No new auto-compaction tasks have been created by the coordinator in the last ~40 hours. This leads to segment count increase substantially.

After debugging found that there is a long running compaction task in running state. Needed to kill it manually for auto-compaction to resume. The coordinator process is waiting for long-running compaction tasks to complete before submitting new compaction tasks.

Even when taskSlots are empty this issue was seem. We are running compaction task in separate tier.

sachidananda007 commented 1 month ago

slack thread for this issue https://apachedruidworkspace.slack.com/archives/C0309C9L90D/p1719990602054439