search

silverton-io / buz

Serverless multi-protocol + multi-destination event collection system.
https://buz.dev/
Apache License 2.0
186 stars 21 forks source link

Durability and batching #593

Open rstml opened 2 months ago

rstml commented 2 months ago

Hello,

This is perhaps a discussion topic rather than an issue. However, given that discussions restricted, posting here.

Assuming that Buz is configured with Kinesis Firehose how does Buz handle failures?

  1. What durability guarantees does Buz provide? Will it acknowledge success to the input only after it receives acknowledgement from the sink (e.g. Firehose)?
  2. Does Buz do any batching as a collector? If yes, what happens if the node fails?

Would be good to clarify these in the docs too.