itinycheng / flink-connector-clickhouse

Flink SQL connector for ClickHouse. Support ClickHouseCatalog and read/write primary data, maps, arrays to clickhouse.
Apache License 2.0
349 stars 149 forks source link

通过writeLocal判断创建是batch/shard的逻辑是否反了? #1

Closed Aireed closed 2 years ago

Aireed commented 2 years ago

image 这个判断是batch还是shard 逻辑是不是应该改成这样?原来的逻辑写反了??

itinycheng commented 2 years ago

image 这个判断是batch还是shard 逻辑是不是应该改成这样?原来的逻辑写反了??

HI Aireed: 原有逻辑是正确的,README.md上对write-local有参数说明; 这个参数在Distributed表中才会起到作用,在非Distributed中需将write-local设置为false,不然会报错; createShardOutputFormat作用是获取Distributed表对应的Local表并创建OutputFormat,后续会将数据直接写入Local表。