search

SAP / kafka-connect-sap

Kafka Connect SAP is a set of connectors, using the Apache Kafka Connect framework for reliably connecting Kafka with SAP systems
Apache License 2.0
122 stars 56 forks source link

Read Table From Offest #103

Open walkinverse opened 2 years ago

walkinverse commented 2 years ago

We have extremely large HANA tables and cannot import all rows on initial load.

Is there a way with the connector to start a row x and then only track from that point forward after import?

Example 2 billions rows.

Need to start at tow 1,900,000. It reads 100K rows, then watches for changes from that point forward.

elakito commented 2 years ago

No but for such purpose, maybe we could make the default where-clause to be be configurable or if it is an incrementing scenario, make the initial incrementing value configurable. Contributions are welcome.