search

itinycheng / flink-connector-clickhouse

Flink SQL connector for ClickHouse. Support ClickHouseCatalog and read/write primary data, maps, arrays to clickhouse.
Apache License 2.0
373 stars 156 forks source link

怎么可以加快同步速度 #85

Open ysq5202121 opened 1 year ago

ysq5202121 commented 1 year ago

如题

ysq5202121 commented 1 year ago

我又2千万数据需要同步，发现半个小时才同步30万

ysq5202121 commented 1 year ago

image

itinycheng commented 1 year ago

disable chain看下具体哪个operator慢；

ysq5202121 commented 1 year ago

disable chain看下具体哪个operator慢； 这个怎么操作 @itinycheng

ysq5202121 commented 1 year ago

image 大数据似乎会报错

ysq5202121 commented 1 year ago

传输不完整，2000W数据传输好多次总是不完整，漏数据