search

housepower / clickhouse_sinker

Easily load data from kafka to ClickHouse
https://housepower.github.io/clickhouse_sinker
Apache License 2.0
514 stars 118 forks source link

partition xx quit idle or partition xx became idle #170

Closed LeeMo2K10 closed 1 year ago

LeeMo2K10 commented 1 year ago

I has encountered this problem！can you help me?

{"level":"info","ts":"2022-12-18T10:00:27.166Z","msg":"topic DSP_EVENT_NEW partition 3 became idle","task":"CG_DSP_CLICKHOUSE_SINKER"} {"level":"info","ts":"2022-12-18T10:00:28.575Z","msg":"topic DSP_EVENT_NEW partition 3 quit idle","task":"CG_DSP_CLICKHOUSE_SINKER"}

yuzhichang commented 1 year ago

They are normal. clickhouse_sinker maintains buffer for each topic+partition. It frees the buffer if it doesn't see records from that topic+partition for given duration.