itinycheng / flink-connector-clickhouse

Flink SQL connector for ClickHouse. Support ClickHouseCatalog and read/write primary data, maps, arrays to clickhouse.
Apache License 2.0
347 stars 149 forks source link

怎么可以加快同步速度 #85

Open ysq5202121 opened 12 months ago

ysq5202121 commented 12 months ago

如题

ysq5202121 commented 12 months ago

我又2千万数据需要同步,发现半个小时才同步30万

ysq5202121 commented 12 months ago

image

itinycheng commented 12 months ago

disable chain看下具体哪个operator慢;

ysq5202121 commented 11 months ago

disable chain看下具体哪个operator慢; 这个怎么操作 @itinycheng

ysq5202121 commented 11 months ago

image 大数据似乎会报错

ysq5202121 commented 11 months ago

传输不完整,2000W数据传输好多次总是不完整,漏数据