SAP / kafka-connect-sap

Kafka Connect SAP is a set of connectors, using the Apache Kafka Connect framework for reliably connecting Kafka with SAP systems
Apache License 2.0
119 stars 54 forks source link

Fix the source task generation #98

Closed elakito closed 2 years ago

elakito commented 2 years ago

This change moves the source table inspection previously performed in the source task to the source connector so that the tasks can be created correctly and distributed to the available number of workers.

It resolves one of the problems reported by #89, namely using a tasks.max > 1 creating multiple tasks pulling the same set of data, thereby generating duplicates.