tabular-io / iceberg-kafka-connect

Apache License 2.0
169 stars 31 forks source link

commit complete but 0 tables #251

Open utkanbir opened 1 month ago

utkanbir commented 1 month ago

Hi, I am getting this error and nothing is written to iceberg. Anyone have the same issue?

Sending event of type: COMMIT_COMPLETE (io.tabular.iceberg.connect.channel.Channel) Commit 1428dc54-30a0-4ec1-9707-f8a99cdc478f complete, committed to 0 table(s), vtts null (io.tabular.iceberg.connect.channel.Coordinator)

this is the config:

{ "iceberg.catalog.s3.secret-access-key": "", "iceberg.catalog.s3.endpoint": "http://192.168.0.12:9000", "iceberg.catalog.io-impl": "org.apache.iceberg.aws.s3.S3FileIO", "iceberg.catalog.client.region": "us-west-1", "iceberg.hadoop.fs.s3a.path.style.access": "true", "iceberg.catalog.warehouse": "s3a://warehouse", "iceberg.catalog.type": "hadoop", "iceberg.catalog.s3.path-style-access": "true", "iceberg.hadoop.fs.s3a.connection.ssl.enabled": "false", "iceberg.catalog.s3.access-key-id": "", "name": "iceberg2", "connector.class": "io.tabular.iceberg.connect.IcebergSinkConnector", "errors.log.enable": "true", "errors.log.include.messages": "true", "topics": [ "customer" ], "errors.deadletterqueue.context.headers.enable": "true", "iceberg.tables": [ "customer" ], "iceberg.tables.auto-create-enabled": "true", "iceberg.tables.schema-force-optional": "true", "iceberg.control.commit.interval-ms": "3000" }

gaydba commented 1 month ago

make sure you have non empty "customer" topic i had the same problem when there was a mishap with topic name

Petrnn commented 3 weeks ago

@utkanbir I have the same issue, did you find a solution or mistake?