a8m / kinesis-producer

An aggregated records producer for Amazon Kinesis
MIT No Attribution
149 stars 51 forks source link

Aggregation Issues #27

Open rvsubbu opened 4 years ago

rvsubbu commented 4 years ago

The aggregator uses the same key for all records. This creates problem in the downstream flow - e.g. we map the key to a Kafka partition, and our mapping flow breaks when we try to feed Kinesis records into Kafka. This is mentioned as a problem in comments. Any chance of getting this addressed in the near future?

Also, there doesn't seem to be mapping of key to shard. Such a mapping would be a great help...