housepower / clickhouse_sinker

Easily load data from kafka to ClickHouse
https://housepower.github.io/clickhouse_sinker
Apache License 2.0
519 stars 117 forks source link

貌似不支持分布式表的插入 #41

Closed Aload closed 4 years ago

sundy-li commented 4 years ago

支持的, table可以定义为单表 分布式表

Aload commented 4 years ago

单表的情况确实可以插入 ,我测试过了。 分布式的表我这边貌似是插入不进去。 以下是我的配置: { "clickhouse": { "ch1": { "db": "default", "host": "cdh03", "maxLifeTime": 300, "password": "fangte2019", "retryTimes" : 5, "port": 9020, "username": "default" } }, "kafka": { "kfk1": { "brokers": "cdh01:9092,cdh02:9092,cdh03:9092", "version": "2.1.0" } }, "common": { "bufferSize": 90000, "minBufferSize": 2000, "flushInterval": 5, "logLevel": "info" } }

{ "name" : "tracelog", "kafka": "kfk1", "topic": "app_track_ten", "earliest" : true, "consumerGroup" : "trace_group", "parser" : "json", "clickhouse" : "ch1", "tableName" : "sink_track", "@desc_of_autoSchema" : "auto schema will auto fetch the schema from clickhouse", "autoSchema" : true, "@desc_of_exclude_columns" : "this columns will be excluded by insert SQL ", "excludeColumns" : [], "bufferSize" : 90000 }

在 2020-02-19 11:56:21,"sundyli" notifications@github.com 写道:

支持的, table可以定义为单表 分布式表

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.

sundy-li commented 4 years ago

I'm sure it's not the problem of clickhouse_sinker, check your distribute table plz.