-
**Description**
Without implementing idempotent Kafka consumer the database is fully reconstructed every time cfe_39 is started. By implementing idempotent Kafka consumer the consumer will skip proce…
-
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
**Describe the solution you'd like**…
-
/area runtime
## Describe the feature
[Idempotency concept](https://www.enterpriseintegrationpatterns.com/patterns/messaging/IdempotentReceiver.html) in messaging means a message that has the sa…
-
**Description**
By registering a ConsumerRebalanceListener to a consumer in the consumer group, the listener can be used for tracking the record offsets inside a batch.
The listener must be initiali…
-
https://docs.confluent.io/current/kafka-rest/api.html#get--consumers-(string-group_name)-instances-(string-instance)-records appears to have the potential for data loss. If a GET response is lost, the…
-
# Idempotent Processing with Kafka | Nejc Korasa
Duplicate Messages are Inevitable Understanding the Intricacies of exactly-once semantics in Kafka Achieving Idempotent Processing with Kafka Idempote…
-
For users of Consumer Groups we should provide a failure detector and Position store for at least once processing of events. This eliminates the need to re-write this logic for applications which are …
-
On both versions of AKHQ 0.17 and 0.19 we were not able to list the consumer groups in the overview with the following rights:
`ALLOW | DESCRIBE_CONFIGS | CLUSTER | kafka-cluster | LITERAL`
`AL…
-
Description
===========
confluent-kafka-go: 1.4.2
librdkafka: 17040127 1.4.2-dirty
broker: cp-kafka docker image, tried with `5.3.1 (Kafka 2.3.0)` and `5.5.1 (Kafka 2.5.0)`
OS: Linux 5.7.17-2-MAN…
-
Implement real-timeish datasource that allows reading
- Latest data from Kafka (last few records)
- Semi latest data from HDFS (Last Few Days)
- Old data from Archive S3 (As is already done)