-
We are trying to post every Log message generated from every application to Cloud Elasticsearch service using Kinesis Stream and FireHose Delivery Stream.
In the attempt, we are using KPL code usi…
-
-
I am getting these errors. Normally in my corporate environment, I patch the Java cacerts with key tool, and already did that.
However I see that there are cacerts folder created in the /tmp/amazon-k…
-
Is it possible to avoid this error when calling producer.destroy() to end the program? It doesn't seem to cause any issues, but I always see this:
[pool-1-thread-6] WARN com.amazonaws.services.kinesis…
-
RetryingBatchedClickEventsToKinesis.java
Line 63:
```
Math.min(MAX_BACKOFF, backoff *= 2);
```
Should read:
```
backoff = Math.min(MAX_BACKOFF, backoff * 2);
```
-
Maybe I'm missing something, but it looks like there's no obvious way to use this library with a VPC interface endpoint for Kinesis streams, to keep traffic internal to a VPC (and avoid the costs of s…
-
When we update records more than 10k, maxwell drops a large chunk of records (say appro 2,000 - 3,000 records) while pushing data to AWS kinesis stream.
We figured this out by checking maxwell logs,…
-
We were having issues with data loss. We logged the data sent to kinesis from our producers and compared the data in our sinks. We are 100% sure that the data was pushed to kinesis but the data for 1 …
-
Kinesis rejects PutRecords requests over 5 megabytes, but the batch producer doesn't do anything to make sure it doesn't exceed 5 megabytes in its requests.
When this failure is hit, we've seen our b…
-
Quick one - how is this implementation (link below) of Kinesis consumer and producer in boto different from KCL python? When should one opt for KCL Python vs. plain boto?
Link - [Snakes in the Stre…