twitchscience / kinsumer

Native Go consumer for AWS Kinesis streams.
Other
134 stars 35 forks source link

Manual commit checkpoint to ddb table #41

Open alllomancer opened 5 years ago

alllomancer commented 5 years ago

we want to run multiple instance of a kinesis consumer app in a k8s enviorment. in order to make sure that we read and work on the data at least once we need to be able to extract the record from the stream, then perform some work, and only then commit the shard position to the ddb table.

i was wondering if this can be done in the kinsumer?