DTStack / chunjun

A data integration framework
https://dtstack.github.io/chunjun/
Apache License 2.0
4.01k stars 1.69k forks source link

[BUG] 1.12版本,sql+flink yarn pre模式使用upsert-kafka-x连接器报错 #735

Open ranheqiao opened 2 years ago

ranheqiao commented 2 years ago

主要报错信息: ----------sql end--------- Unsupported options found for connector 'upsert-kafka-x'. Unsupported options: format scan.startup.mode sink.partitioner sink.semantic Supported options: connector key.fields-prefix key.format key.json.fail-on-missing-field key.json.ignore-parse-errors key.json.map-null-key.literal key.json.map-null-key.mode key.json.timestamp-format.standard properties.bootstrap.servers property-version sink.parallelism topic value.fields-include value.format value.json.fail-on-missing-field value.json.ignore-parse-errors value.json.map-null-key.literal value.json.map-null-key.mode value.json.timestamp-format.standard Unable to create a source for reading table 'default_catalog.default_database.sinkCache'. Table options are: 'connector'='upsert-kafka-x' 'format'='json' 'key.format'='json' 'properties.bootstrap.servers'='dcqc11-9:9092,dcqc11-10:9092,dcqc11-11:9092' 'scan.startup.mode'='earliest-offset' 'sink.partitioner'='default' 'sink.semantic'='at-least-once' 'topic'='sinkCache' 'value.format'='json' at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) at org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:158) at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:82) at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:117) at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:569) at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:484) ... 2 more Caused by: com.dtstack.flinkx.throwable.FlinkxRuntimeException: com.dtstack.flinkx.throwable.DtSqlParserException:

Paddy0523 commented 2 years ago

It looks like the kafkaConnector plugin is not loaded