search

twitchscience / kinsumer

Native Go consumer for AWS Kinesis streams.
Other
134 stars 35 forks source link

De-aggregation of records #39

Open kapadiakunal opened 5 years ago

kapadiakunal commented 5 years ago

Hi @GarethLewin,

We've a producer which aggregates and sends records as per KPL and we're consuming records using this library. But we are getting garbage values in the records as mentioned here. Does this library take care of de-aggregation of records?

garethlewin commented 4 years ago

Hi @kapadiakunal we do not currently de-aggregate records, but it appears as if that is relatively easy to add support for, see https://github.com/awslabs/kinesis-aggregation/blob/master/go/deaggregator/deaggregator.go#L23

I'd appreciate a PR, but if not I will attempt to get this done soon.