nikepan / clickhouse-bulk

Collects many small inserts to ClickHouse and send in big inserts
Apache License 2.0
474 stars 87 forks source link

Reducing log output #63

Open derN3rd opened 1 year ago

derN3rd commented 1 year ago

Hey there,

To install clickhouse-bulk on our server I added a systemd service for it. I just noticed that we frequently get issues with our journal log filling up the whole disk space. I've tried to reconfigure systemd-journal to limit disk usage, but as the clickhouse-bulk log spits out so much data we miss out a lot of data then (e.g. log file is growing >100mb per hour)

Could me make the "sending x rows" and "sent x rows" messages configurable so I can deactivate them and only log warn/error messages?

Thanks in advance