search

memiiso / debezium-server-iceberg

Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)
Apache License 2.0
171 stars 35 forks source link

Debezium server is failing to create a table because of an invalid table identifier #369

Open mevadadhruv opened 1 week ago

mevadadhruv commented 1 week ago

Hello,

I'm reaching out to discuss an issue we're facing while setting up the Debezium-Iceberg integration in our architecture. We followed the steps outlined in Chris Cranford (Naros)'s blog post (https://debezium.io/blog/2022/09/30/debezium-oracle-series-part-1/) and ensured that the Oracle database user has been granted the necessary privileges as described in the Debezium documentation.

However, we've encountered an error that we're struggling to resolve. The error message in the logs indicates that the Debezium server is failing to create a table due to an invalid table identifier: apacheiceberg.debeziumcdc_aws_DNT_TEST. This issue arises during the processing of change data capture (CDC) events using the Iceberg sink connector.

Attached is a screenshot showing the exact error message for reference.

We would greatly appreciate any guidance or assistance you can provide to help us resolve this issue.

Thank you for your support.

Best regards, Dhruv Mevada image (1)

ismailsimsek commented 1 week ago

@mevadadhruv as mentioned before please check that Glue catalog naming rules are supporting the naming you are using.

please test with Skip Name Validation config

https://github.com/memiiso/debezium-server-iceberg/issues/365#issuecomment-2181033713

the details of glue catalog here https://iceberg.apache.org/docs/nightly/aws/?h=glue#glue-catalog

mevadadhruv commented 1 week ago

also i was checking this issue in the debezium community side where Vojtech Juranek suggested us the "SMT". from the iceberg side it'll also help right ?