-
One use case for Kafka is as a message broker for distributing events in an event-sourced application. As part of this ticket, we will show how to model events using Apache Avro and how to integrate i…
-
This is the start of Scale's new messaging passing architecture to improve scalability.
All of this should be in a Django app, called "messaging"?
Base class CommandMessage
- self.succeeded - use…
-
@adamdubiel
We often use hermes-manager end points to deactivate /activate subscription (pause ), yesterday we noticed around 1900 messages lost and never received. I have the hermes message ids pr…
-
If an offset is lost completely due to an out of range error, KafkaConsumer has an attribute `auto_offset_reset` which controls what to do in that scenario. By default this is set to `latest`. This wo…
-
Implementation of only-once guarantee on the producer side
https://cwiki.apache.org/confluence/display/KAFKA/Idempotent+Producer
-
Inspired by this little [tweetstorm](https://twitter.com/dan_abramov/status/710642981016100864).
## Problem: Side Effects and Composition
We discussed effects in Redux for ages here but this is the f…
-
I witnessed the following behavior on Heroku, which seems to imply that the last successfully acknowledged offset might be trailing from reality. Observe the following `offset` output before and after…
-
We are seeing severse performance issues with Logstash 2.4.1. Basically, after some amount of time (from a few hours to a few days), the throughput of Logstash is severely diminished. The service is s…
-
Hi, We noticed the following behavior and we think it is not right when we use this
to write dataframe to redshift database.
1) write to S3 is fine.
2) copy to redshift failed with exception such as …
-
Use Apache Kafka as event storage backend. This ticket does **not** include
- an `aggregateId`-based index
- an event log archive
- a snapshot store