scylladb / scylla-cdc-source-connector

A Kafka source connector capturing Scylla CDC changes
Apache License 2.0
48 stars 18 forks source link

Add support for streaming preimage in kafka #38

Open shantanu-sharechat opened 1 year ago

shantanu-sharechat commented 1 year ago

Currently the before value in Kafka Message is always null as mentioned in the doc https://github.com/scylladb/scylla-cdc-source-connector#cell-representation.

The scylla cdc table already has preimage support as mentioned in the official docs here https://opensource.docs.scylladb.com/stable/using-scylla/cdc/cdc-preimages.html.

Add support for streaming the preimages stored in CDC table to Kafka Connector.