search

jaykelin / clickhouse-hdfs-loader

loading hdfs data to clickhouse
MIT License
73 stars 42 forks source link

修复插入相关目标表报错问题 #6

Closed wpp0525 closed 4 years ago

wpp0525 commented 5 years ago

错误信息如下

2018-11-06 11:50:20,575 INFO [main] com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper: Clickhouse Loader : try [2] loading data to cluster -> {"cluster":"10.113.1.90","shard_num":1,"nodes":["10.113.1.90"]} 2018-11-06 11:50:20,575 INFO [main] com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper: Clickhouse Loader : try [2] loading data to host -> 10.113.1.90, batchsize -> 1000 2018-11-06 11:50:20,680 ERROR [main] com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper: Clickhouse JDBC : failed. COUSE BY ClickHouse exception, code: 81, host: 10.113.1.90, port: 8123; Code: 81, e.displayText() = DB::Exception: Database null doesn't exist, e.what() = DB::Exception

ru.yandex.clickhouse.except.ClickHouseException: ClickHouse exception, code: 81, host: 10.113.1.90, port: 8123; Code: 81, e.displayText() = DB::Exception: Database null doesn't exist, e.what() = DB::Exception

at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:57)
at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:28)
at ru.yandex.clickhouse.ClickHouseStatementImpl.getInputStream(ClickHouseStatementImpl.java:445)
at ru.yandex.clickhouse.ClickHouseStatementImpl.executeUpdate(ClickHouseStatementImpl.java:138)
at com.kugou.loader.clickhouse.ClickhouseClient.insert(ClickhouseClient.java:85)
at com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper.batchDirectInsert(AbstractClickhouseLoaderMapper.java:327)
at com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper.batchInsert(AbstractClickhouseLoaderMapper.java:366)
at com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper.cleanup(AbstractClickhouseLoaderMapper.java:104)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

Caused by: java.lang.Throwable: Code: 81, e.displayText() = DB::Exception: Database null doesn't exist, e.what() = DB::Exception

at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:56)
... 15 more

2018-11-06 11:50:20,681 ERROR [main] com.kugou.loader.clickhouse.mapper.AbstractClickhouseLoaderMapper: Clickhouse JDBC: ERROR SQL:INSERT INTO null.null FORMAT TabSeparated