vmware / vmware-go-kcl-v2

vmware-go-kcl is a vmware originated open-source project for AWS Kinesis Client Library in Go. It has been widely used by many external companies and internally by Carbon Black. vmware-go-kcl-v2 is its companion project by utilizing AWS Go SDK V2 which introduces lots of breaking changes. To keep the repo clean, it is better to have a separated repo vmware-go-kcl-v2 with better golang project structure improvement.
MIT License
23 stars 17 forks source link

Can we use this library with dynamo db streams endpoint #46

Open ravikiran-zoman opened 1 year ago

ravikiran-zoman commented 1 year ago

Additional context

Alternative to this would be to use the kinesis data streams enabled for the dynamodb table. But with this we will loose some of the features provided by the DynamoDbKinesisStreamAdapter which are as follows ,

  1. Exactly once guarantee
  2. Each stream record appears in the same order of modifications made to a table item.
  3. Automatic handling of new or expired shards, in addition to shards that split while the application is running. And also it makes sure that parent shard is completed before the child shards are processed.

Are these features will still be available if we use kinesis data streams enabled for the dynamodb and use this library to process the stream records. ?

@taoj-action can you please kindly help with this issue ?