search

databricks / iceberg-kafka-connect

Apache License 2.0
220 stars 49 forks source link

Kafkaconnector do not create new metadata files #269

Open thuybt opened 4 months ago

thuybt commented 4 months ago

Hi team, after running multiple time I found out that iceberg kafkaconnector do not create new metadata files to the metadata folder.

haripriyarhp commented 2 months ago

Hi, Is there any input on this? I also use this connector to write the files to S3. But suddenly after a while, files are written into data folder but there is not metadata generated. The table returns 0 records when querying this partition but there are files present in the same partition in S3.

haripriyarhp commented 2 months ago

@thuybt: Did you find any solution?

thuybt commented 2 months ago

Hi Hari, I have resolved the issue. Please help check :

fuzing commented 1 week ago

@haripriyarhp / @thuybt - is this your issue perhaps? #308