-
Hi,
I've been trying to setup integration tests with localstack where I could:
1. create a stream
2. create and start consumer reading from stream
3. wait for consumer to be assigned to shard
4…
-
Quick one - how is this implementation (link below) of Kinesis consumer and producer in boto different from KCL python? When should one opt for KCL Python vs. plain boto?
Link - [Snakes in the Stre…
-
Hi @itsvikramagr,
Thanks again for writing this library and providing constant support to community.
Our spark structure streaming code doesn't need to be stateful. We are ok with cluster or ex…
-
I have been trying to use it as background service on ubuntu 16.06. absolute paths gives exception
` /home/ubuntu/kcl/bin/kcl-bootstrap --java /usr/bin/java -e -p /home/ubuntu/kcl/samples/basic_sampl…
-
This code is very helpful for understanding how to work with Kinesis Data Streams - thank you!
While sifting through it, I noticed that `retries`, which controls the `ShardReader`'s back-off is nev…
-
We are in the process of upgrading several consumers to KCL 2.0. They are attached to a somewhat large stream (thousands of shards) and have been running on KCL 1.x for a long time without issue.
T…
echo8 updated
6 months ago
-
While the capability to consume and produce kinesis streams is a wonderful bootstrap set up, It is a good idea to separate the kinesis consumer itself into a separate NuGet package and consume it from…
-
Hi There -
Something that I'm struggling with when using this library is that I can only set up single-event processors for the Consumer via ConsumerWorker. This limits me from using this library …
-
There was a change here https://github.com/awslabs/cloudwatch-logs-subscription-consumer/commit/9eef3cd025d8725e62c15b72dc80c36417ccf3c8 to support adding JSON extracted fields with a non-JSON prefix.…
-
Maybe I'm missing something, but it looks like there's no obvious way to use this library with a VPC interface endpoint for Kinesis streams, to keep traffic internal to a VPC (and avoid the costs of s…