search

shikhar / kafka-connect-dynamodb

Kafka Connector for DynamoDB
Apache License 2.0
34 stars 50 forks source link

SinkConnector - Support upsert logic (see below) #23

Closed ofirsharony closed 5 years ago

ofirsharony commented 5 years ago

Add conditions to sink connector logic to support upsert functionality:

  1. Add a new item in case the record_key doesn't exist (via 'attribute_not_exists' condition)
  2. If the key exists, update the record only if a newer record_version is given.