Altinity / clickhouse-sink-connector

Replicate data from MySQL, Postgres and MongoDB to ClickHouse®
https://www.altinity.com
Apache License 2.0
234 stars 54 forks source link

Problem with replicate_schema_history table #742

Closed byte09 closed 3 months ago

byte09 commented 3 months ago

236 INFO - Starting PostgresConnectorTask with configuration: 2024-08-08 04:49:25.236 INFO - connector.class = io.debezium.connector.postgresql.PostgresConnector 2024-08-08 04:49:25.237 INFO - schema.history.internal.schema.history.table.name = "default.replicate_schema_history" 2024-08-08 04:49:25.237 INFO - schema.history.internal.jdbc.schema.history.table.ddl = CREATE TABLE if not exists %s (id VARCHAR(36) NOT NULL, history_data VARCHAR(65000), history_data_seq INTEGER, record_insert_ts TIMESTAMP NOT NULL, record_insert_seq INTEGER NOT NULL) ENGINE=ReplacingMergeTree(record_insert_seq) order by id 2024-08-08 04:49:25.237 INFO - schema.include.list = paperless 2024-08-08 04:49:25.237 INFO - schema.history.internal.jdbc.schema.history.table.name = metrika.replicate_schema_history

After start in log i see [schema.history.internal.schema.history.table.name = "default.replicate_schema_history"]

But table doesn't create in scheme 'default'

In my config [schema.history.internal.jdbc.schema.history.table.name = metrika.replicate_schema_history] but table doesn't create in scheme 'metrika'.

What am I doing wrong?

subkanthi commented 3 months ago

@byte09 postgres ddl changes are not emitted by debezium connector so it's expected that the schema changes table will not be created, we have a issue to remove those configuration variables

byte09 commented 3 months ago

Ok, thanks!