-
We have been using the KCL for the 9 months or more in our production and staging near-real time pipeline. We use a Ruby, Java, and Python KCL-based clients, so our Kinesis data pipeline is polyglot. …
-
I'm fairly new to Kinesis and any help is greatly appreciated.
I pretty much followed the code example on AWS to the letter but every single callback fails with a null message. I'm pretty stuck now a…
-
I am able to write to the kinesalite stream using the AWS SDK with no issue. I have a Java Kinesis consumer worker which produces the attached exception and ultimately closes down. I cannot find any o…
-
Hi!
I am trying to use kinesalite and dynalite for integration tests purpose, but cant figure out how to set everything up.
First of all im using:
Java 8
amazon-kinesis-client 1.8.8
amazon-ki…
-
This ties in to #89 a bit. Imagine the same scenario I describe in that issue. You want to reprocess a specific chunk of data in the Kinesis stream. With any of the approaches you might use, you need …
-
### Describe the bug
The current worker implementation will only grab a lease for a single shard per shard sync interval. This seems like a bug. Based on the commit message (e2a945d824043765a899686…
-
This tool of yours has been behaving admirably given the load we're pushing through it, but occasionally data from a kinesis stream will stop being fetched.
The behavior where no data is fetched fr…
-
I'm using KCL 2.1.1 on OpenJDK Runtime Environment (build 1.8.0_191-b12)
I think I broke things for my KCL workers by deleting my kinesis stream and recreating it while my consumer was running. I …
-
I think the checkpointer should be called here, without arguments:
https://github.com/aserrallerios/kcl-akka-stream/blob/master/src/main/scala/aserralle/akka/stream/kcl/IRecordProcessor.scala#L56
…
-
**Background context**
As part of webhook pipeline optimisation we have started to introduce parallelisation on replication tasks to allow Kinesis shards to be better utilised. We need to update the …