databricks / iceberg-kafka-connect

Apache License 2.0
220 stars 49 forks source link

docs(README): update control topic part #259

Open farbodahm opened 5 months ago

farbodahm commented 5 months ago

This PR is related to issue #247.

Using the same control topic for multiple connectors that consume from different topics can lead to unexpected behavior. In my experience, we had over 20 connectors sinking data from more than 20 topics, all sharing the same control topic, which caused the issues described in #247.

tabmatfournier commented 5 months ago

FYI we aren't really merging anything more into this repo, as it's being airlifted into iceberg core. See https://github.com/apache/iceberg/pulls?q=is%3Apr+is%3Aopen+connector+label%3AKAFKACONNECT.

You may also want to comment there

farbodahm commented 5 months ago

Thanks @tabmatfournier; I couldn't find the README there, where should I open my PR to mention the point in this PR?