memiiso / debezium-server-iceberg

Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)
Apache License 2.0
191 stars 35 forks source link

In Debezium iceberg, unable to Convert the uppercase_underscore to lowercase_underscore in Oracle connector. #391

Open ASLDnT opened 3 months ago

ASLDnT commented 3 months ago

Hi Team,

We wanted to inform you about an issue we faced with our Iceberg consumer component. It was not accepting schema names, usernames, and table names in UPPERCASE_UNDERSCORE format.

To solve this, I created a dummy Oracle database on my local system and converted these names to lowercase_underscore format, which worked well. However, the real challenge we now face is that our actual source Oracle DB uses the UPPERCASE_UNDERSCORE format.

We need to convert these names directly within Iceberg without using Kafka. We attempted to use SMT (Single Message Transforms), but it appears that SMT requires Kafka, making it unsuitable for our needs.

Could someone suggest a better solution for this conversion?

Thank you, DnT

ASLDnT commented 3 months ago

Good Morning everyone, anyone?

ismailsimsek commented 3 months ago

this option is now implemented in 0.6.0.Final release

ASLDnT commented 3 months ago

Hi @ismailsimsek, Thank you For this release now our problem has been resolved. Thank you, DnT