-
Hello,
I'm using monix-kafka's `KafkaConsumerObservable.manualCommit` consumer to consume data from kafka in a batch application.
We consume data until there is no more (using `.timeoutOnSlowUpstrea…
-
Hi,
Need some help.
New to Kafka and read an article about implementing ['Exactly Once' consumer](http://126kr.com/article/6mwmx81h2zq). Can I use kafka-node to achieve the same thing? If yes, w…
-
/area runtime
## Overview
Hi guys. Maybe Dapr could provide an outbox & inbox infrastructure since any distributed app development framework needs it to make sure domain events are published and…
-
Jira Link: [DB-6530](https://yugabyte.atlassian.net/browse/DB-6530)
### Description
Background
xCluster replication replicates data changes from a producer universe to a consumer universe.
I…
-
Hello everyone! I have a question regarding the number of threads being created. As far as I know, librdkafka creates the following number of threads:
Total number of threads = 2 + Number of brokers.…
-
The purpose of this issue is to list checkpoints related to Kafka usage that should be validated before _releasing_ the POC (both on the external application and DT side).
### Requirements
- [ ]…
-
I understand that this is a significant request, but if the Helm maintainers are not inclined to implement it, I would like to ask for permission to fork the project and explore the possibility myself…
-
One of the customers asked a question if we can rollback a message if it failed to be consumed and retry it later. This is a very common handling pattern while working with MQ Queue which supports XA …
-
Kafka 允許使用者在讀寫資料時,當 topic 不存在則立刻用預設參數建構一個。這種用法可以方便使用者在讀寫端避免介入 admin 的操作,同時具備一定的容錯(不用事先檢查是否建立),然而這種使用方式有一個副作用,那就是容易產生 idle topics。
idle topics 產生的副作用就是系統內會堆疊許多許多的 partitions,當叢集的操作涉及到所有 partitions 時…
-
### Affected URL(s)
https://nodejs.org/api/stream.html#readable_readsize
### Description of the problem
I'm implementing a readable stream, and found the following part of the documentation to be u…