search

akka / alpakka

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
https://doc.akka.io/libraries/alpakka/current/
Other
1.26k stars 645 forks source link

support for Dynamodb Streams #447

Open joost-de-vries opened 7 years ago

joost-de-vries commented 7 years ago

I've implemented a first naïve support for Dynamodb Streams. You can find the implementation here. And this is how to use it.

I'm saying that it's a naïve implementation because it just follows the example from the docs. And that example ignores new shards, expired shards and shards splitting. The AWS docs just advise to use the Kinesis Adapter instead of documenting how to deal with these features.

Given that it's not that explicitly documented how to deal with those cases it will take some reverse engineering to get those aspects right. I guess we can study the code of the Dynamodb - Kinesis adapter. And we can do load tests....

Any interest in further implementing this?

joost-de-vries commented 7 years ago

@areyouspiffy I think you've implemented Dynamodb Streams once. Do you have any ideas on this?