-
Secor uploads files (different content) with the same "name" into different days when first day ends and the next begins.
In the example below, I have two files:
```
/topic-name/dt=2021-06-15/…
-
`plugin install --version` fails
From:
https://discuss.elastic.co/t/install-specific-plugin-version/1407
```
sudo /opt/logstash/bin/plugin install --version 0.2.5 logstash-output-elasticsearch
Val…
-
## 如何从 Kafka 恰好取得一次消息？
流式消息投递，为了保证消息不丢，出现网络问题就需要重试。既然重试，就有重复投递消息的可能性，那么怎么做消息去重呢？
这被称为“恰好一次” (exactly-once messaging) 。要实现“恰好一次”语义分为两个部分：
- 产生消息时避免重复
- 消费消息时避免重复
消息生产期间获得“恰好一次”语义的 2 种方法：
1.…
-
**Is your feature request related to a problem? Please describe.**
When in this scenario:
Broker has a topic with 2 partitions, we have two application instances which has same group id to consume t…
-
### Module
Redpanda
### Testcontainers version
1.20.2
### Using the latest Testcontainers version?
Yes
### Host OS
MacOS
### Host Arch
ARM
### Docker version
Client:
Version: 27.…
-
## Motivation
- Message queues such as Kafka and Pulsar can only guarantee the exactly-once semantics provided by the transaction feature under **the specific use scenario of `consume-transform-pro…
-
## Description
I use kafka appender to send logs to kafka server. When kafka server is down, if I start my application at this time, the kafka appender would attemp to connect to kafka continually.…
-
Hi there,
We have a Kafka connect set up for sinking the events from Kafka to Elastic. We are experiencing data consistency issue and was hoping to get some guidance here in case we have issue on o…
-
Source connectors basically will start a consumer endpoint "from uri", but currently no way to add a processor class after from.
The processor is really flexible and can do pretty much everything …
ffang updated
3 years ago
-
One of the customers asked a question if we can rollback a message if it failed to be consumed and retry it later. This is a very common handling pattern while working with MQ Queue which supports XA …