tremor-rs / tremor-runtime

Main Tremor Project Rust Codebase
https://www.tremor.rs
Apache License 2.0
858 stars 125 forks source link

Circuit Breakers and per event destinations #937

Open Licenser opened 3 years ago

Licenser commented 3 years ago

Describe the problem you are trying to solve

We have circuit breakers that handle when destinations are down and reconnect when they're back up. This is great! We also have sinks that allow customizing the destination on a per event level. This is great too!

Together those two aren't great. When a sink chan have a different destination on a per-event level we can't know if the destination is up or down before we get the event so they can't send circuit breaker events :(

Describe the solution you'd like

Notes

mfelsche commented 3 years ago

This will be fixed when we implement Stream Handling throughout the runtime and scope CB events either to the whole sink or to a single stream only. See also the Connectors and Streams RFC: https://github.com/tremor-rs/tremor-rfcs/pull/32