search

ClickHouse / ClickHouse

ClickHouse® is a real-time analytics DBMS
https://clickhouse.com
Apache License 2.0
36.7k stars 6.79k forks source link

When using nifi for data synchronization, data loss occurs when storing data #62688

Open tony08-08 opened 5 months ago

tony08-08 commented 5 months ago

When using nifi to synchronize with clickhouse, data loss always occurs. I would like to ask if there are any recommended ways to optimize clickhouse, or how to configure clickhouse to prevent data loss.

den-crane commented 5 months ago

Apparently you are doing it wrong. And you need to do it right.

tony08-08 commented 5 months ago

It's normal for me to synchronize from nifi to MySQL, but synchronizing to clickhouse always results in data loss

den-crane commented 5 months ago

Then you should use MySQL. Not Clickhouse.

tony08-08 commented 5 months ago

I hope to use clickhouse, but why is it causing data loss.

den-crane commented 5 months ago

I hope to use clickhouse, but why is it causing data loss.

But it's not clickhouse. It could be nifi, or the way how you use nifi.