-
**Description**
Without implementing idempotent Kafka consumer the database is fully reconstructed every time cfe_39 is started. By implementing idempotent Kafka consumer the consumer will skip proce…
-
**Description:**
The Idempotent Customer design pattern is essential in microservices architectures to ensure that repeated processing of the same request does not produce different outcomes. This pat…
-
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
**Describe the solution you'd like**…
-
**Description**
By registering a ConsumerRebalanceListener to a consumer in the consumer group, the listener can be used for tracking the record offsets inside a batch.
The listener must be initiali…
-
/area runtime
## Describe the feature
[Idempotency concept](https://www.enterpriseintegrationpatterns.com/patterns/messaging/IdempotentReceiver.html) in messaging means a message that has the sa…
-
https://docs.confluent.io/current/kafka-rest/api.html#get--consumers-(string-group_name)-instances-(string-instance)-records appears to have the potential for data loss. If a GET response is lost, the…
-
# Idempotent Processing with Kafka | Nejc Korasa
Duplicate Messages are Inevitable Understanding the Intricacies of exactly-once semantics in Kafka Achieving Idempotent Processing with Kafka Idempote…
-
**Chapter Ownership** : @iamzin
-
### Current behaviour
1. Upon receiving any shutdown message from the BEAM, `ConnectionServer.terminate/2` immediately closes the connection.
2. RabbitMQ messages are still being processed successfu…
-
Implement real-timeish datasource that allows reading
- Latest data from Kafka (last few records)
- Semi latest data from HDFS (Last Few Days)
- Old data from Archive S3 (As is already done)