search

nikepan / clickhouse-bulk

Collects many small inserts to ClickHouse and send in big inserts
Apache License 2.0
474 stars 86 forks source link

while got a error,the data send failed until restart #59

Open yangshujing opened 1 year ago

yangshujing commented 1 year ago

while got a error,the data send failed until restart，is a bug?

nikepan commented 1 year ago

can you send example of error for reproduce?

luvs commented 1 year ago

We have same problem. If the clickhouse had problems (the table was in read-only state) the ch-bulk starts saving records in memory, and does not dump them to disk, and does not send them to ch even when it is already available until restart ch-bulk.

yangshujing commented 1 year ago

信件已收到，谢谢！

luvs commented 1 year ago

And I'm not sure, but maybe this only happens if you have several clickhouse servers added to the config (still need to test)