Closed Mayurg6832 closed 11 months ago
The sink relies on the table's identifier column(s) for the primary key for upserts. You will need to set that on your table if you haven't already.
But there is no concept of primary key on Athena tables and Primary key is already set on source Postgres table.
In Iceberg you can define identifier fields, which the sink uses to identify a row. However, it looks like you can't easily set this on the table using Athena. I'll add a config option to specify the columns to use as the key, for cases where it isn't easy to set the identifier fields.
Here's the PR for this: https://github.com/tabular-io/iceberg-kafka-connect/pull/78
This was merged.
Great, Thaks a lot.
I am trying to do upserts on table created on Athena with properties as
here is my connector config
Have tried without cdcField still not working and getting
equality field ids shouldn't be null or empty when creating equality-delete writer
Can you give me some recommendations to resolve this issue? Thanks