housepower / clickhouse_sinker

Easily load data from kafka to ClickHouse
https://housepower.github.io/clickhouse_sinker
Apache License 2.0
514 stars 118 forks source link

clickhouse_sinker_parsing_pool_backlog 如何配置? #177

Closed LeeMo2K10 closed 1 year ago

LeeMo2K10 commented 1 year ago

看监控这个指标打满了, 这个可以设置吗? image

yuzhichang commented 1 year ago

writing_pool_backlog怎么样呢?

LeeMo2K10 commented 1 year ago

image @yuzhichang 您帮看看。

yuzhichang commented 1 year ago

看样子需要提高clickhouse_sinker吞吐量。可以加大 batchSize(最大至100万),flushInterval(最大至600秒),maxConn(与单个clickhousse结点的数据库连接数,默认1)试试看。