search

risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://go.risingwave.com/slack
Apache License 2.0
7.04k stars 579 forks source link

Protocol error: FORMAT DEBEZIUM forbids additional columns, but got ["_rw_kafka_timestamp"] #18222

Closed gaozuo closed 2 months ago

gaozuo commented 2 months ago

Describe the bug

CREATE SOURCE IF NOT EXISTS cdc_hr_waf_core_entity WITH ( connector = 'kafka', --'debezium-avro-confluent.schema-registry.url' = 'http://kafka-stream-registry-cp-schema-registry.kafka-cluster:8081', --'format' = 'debezium-avro-confluent', properties.bootstrap.server = 'kafka-stream-kafka-bootstrap.kafka-cluster:9092', --'properties.group.id' = 'flink-cdc', scan.startup.mode = 'earliest', topic = 'HR.HROUTPUT.WAF_CORE_ENTITY' ) FORMAT debezium ENCODE AVRO ( schema.registry = 'http://kafka-stream-registry-cp-schema-registry.kafka-cluster:8081' )

Error message/log

org.jkiss.dbeaver.model.sql.DBSQLException: SQL 错误 [XX000]: ERROR: Failed to execute the statement

Caused by:
  Protocol error: FORMAT DEBEZIUM forbids additional columns, but got ["_rw_kafka_timestamp"]

    at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:133)

    at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeStatement(SQLQueryJob.java:614)

    at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.lambda$2(SQLQueryJob.java:505)

    at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:194)

    at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeSingleQuery(SQLQueryJob.java:524)

    at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.extractData(SQLQueryJob.java:976)

    at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$QueryResultsContainer.readData(SQLEditor.java:4155)

    at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.lambda$0(ResultSetJobDataRead.java:123)

    at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:194)

    at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.run(ResultSetJobDataRead.java:121)

    at org.jkiss.dbeaver.ui.controls.resultset.ResultSetViewer$ResultSetDataPumpJob.run(ResultSetViewer.java:5152)

    at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:115)

    at org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)

Caused by: org.postgresql.util.PSQLException: ERROR: Failed to execute the statement

Caused by:
  Protocol error: FORMAT DEBEZIUM forbids additional columns, but got ["_rw_kafka_timestamp"]

    at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2725)

    at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2412)

    at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:371)

    at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:502)

    at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:419)

    at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:341)

    at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:326)

    at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:302)

    at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:297)

    at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.execute(JDBCStatementImpl.java:330)

    at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:131)

    ... 12 more

To Reproduce

No response

Expected behavior

No response

How did you deploy RisingWave?

No response

The version of RisingWave

No response

Additional context

No response

gaozuo commented 2 months ago

use "CREATE SOURCE" just fine.