Add sendgrid kinesis to AWS developer tools

sendgridlabs / go-kinesis

GO library for AWS Kinesis

MIT License

134 stars 56 forks source link

Add sendgrid kinesis to AWS developer tools #52

Open jasonrichardsmith opened 8 years ago

jasonrichardsmith commented 8 years ago

This package should be listed here.

http://aws.amazon.com/kinesis/streams/developer-resources/

which can be done by posting here: https://forums.aws.amazon.com/forum.jspa?forumID=169&start=0

le0pard commented 8 years ago

Right now I don't have time to create post on AWS forum. As you wish, you can do it. Thanks in advance.

pavelnikolov commented 8 years ago

@jasonrichardsmith I don't think this library is production ready. One important feature that is missing is synchronizing shard iterators in a multi-instance app (ensuring that different instances do not process duplicate data).

Read this article about dup records and, then this article about scaling/parallel processing.

jasonrichardsmith commented 8 years ago

I have fallen back to the KCL at this point because of the points you illustrated.