Document best practices when building connectors

ConduitIO / conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

https://conduit.io

Apache License 2.0

376 stars 44 forks source link

Document best practices when building connectors #1757

Closed hariso closed 21 hours ago

hariso commented 1 month ago

Feature description

With the many connectors we've written over time, I think we can share some good advice when it comes to writing connectors (setup, snapshots vs CDC in sources, consistent snapshots, different CDC methods, handling keys, positions, etc.).

raulb commented 3 weeks ago

We should make sure we also include a way to test them. See discussion here.