search

housepower / clickhouse_sinker

Easily load data from kafka to ClickHouse
https://housepower.github.io/clickhouse_sinker
Apache License 2.0
515 stars 118 forks source link

when testing, Startup found the following error #145

Closed kkrgwbj closed 2 years ago

kkrgwbj commented 2 years ago

{"level":"info","ts":"2022-02-09T16:25:47.399+0800","msg":"sql.Open and sqlDB.Ping succeeded","dbVer":1,"dsn":"tcp://192.168.10.68:9000?database=test&username=hnmcc_wx&password=hnmcc123&block_size=2097152"} {"level":"info","ts":"2022-02-09T16:25:47.399+0800","msg":"initialized parsing pool","maxWorkers":3,"queueSize":65536} {"level":"info","ts":"2022-02-09T16:25:47.400+0800","msg":"initialized writing pool","maxWorkers":1,"queueSize":3} {"level":"info","ts":"2022-02-09T16:25:47.400+0800","msg":"task initializing","task":"test_dynamic_schema"} {"level":"info","ts":"2022-02-09T16:25:47.449+0800","msg":"Prepare sql=> INSERT INTO test.sso_login_log_new (id,mobile,reqTime,resTime,serverAddress,appId,cityCode,loginType,resCode,reqId,reqModel,reqSysVersion,reqSysSystem,appVersion,appChannel,reqDeviceId,token,openId,reqIp,logoutTime,reqExt1,reqExt2,reqExt3,reqExt4,reqExt5) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)","task":"test_dynamic_schema"} {"level":"info","ts":"2022-02-09T16:25:47.449+0800","msg":"executing sql=> SELECT name FROM system.tables WHERE engine='Distributed' AND database='test' AND match(create_table_query, 'Distributed\(\'test\', \'test\', \'sso_login_log_new\'.\)')","task":"test_dynamic_schema"} {"level":"fatal","ts":"2022-02-09T16:25:47.461+0800","msg":"s.applyConfig failed","error":"Please create distributed table for sso_login_log_new.","errorVerbose":"Please create distributed table for sso_login_log_new.\ngithub.com/housepower/clickhouse_sinker/output.(ClickHouse).initSchema\n\t/data01/zhichyu/clickhouse_sinker/output/clickhouse.go:369\ngithub.com/housepower/clickhouse_sinker/output.(ClickHouse).Init\n\t/data01/zhichyu/clickhouse_sinker/output/clickhouse.go:80\ngithub.com/housepower/clickhouse_sinker/task.(Service).Init\n\t/data01/zhichyu/clickhouse_sinker/task/task.go:98\nmain.(Sinker).applyFirstConfig\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:427\nmain.(Sinker).applyConfig\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:397\nmain.(Sinker).Run\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:311\nmain.main.func2\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:245\ngithub.com/housepower/clickhouse_sinker/util.Run.func1\n\t/data01/zhichyu/clickhouse_sinker/util/app.go:29\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1581","stacktrace":"main.(Sinker).Run\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:312\nmain.main.func2\n\t/data01/zhichyu/clickhouse_sinker/cmd/clickhouse_sinker/main.go:245\ngithub.com/housepower/clickhouse_sinker/util.Run.func1\n\t/data01/zhichyu/clickhouse_sinker/util/app.go:29"} [webapp@haxwtest clickhouse_sinker]$

kkrgwbj commented 2 years ago
image

this is my table;

yuzhichang commented 2 years ago

Read the log carefully:

"error":"Please create distributed table for sso_login_log_new."
kkrgwbj commented 2 years ago

Does it have to be a distributed table, is it not a normal MergeTree engine table?

@yuzhichang