tenzir / public-roadmap

The public roadmap of Tenzir
https://docs.tenzir.com/roadmap
4 stars 0 forks source link

Tap into Flowing Data between Operators in Managed Pipelines #117

Open dominiklohmann opened 6 months ago

dominiklohmann commented 6 months ago

When a pipeline behaves unexpectedly, users need to look into what's happening for their pipeline. For this, we want to add a feature that allows users to tap into the dataflow of pipelines.

This is a two-step process:

  1. Implement a tap source operator that given a pipeline id and an operator id shows the data flowing out of that operator.
  2. Design and implement how the user interacts with the tap operator in the app.
### Definition of Done
- [ ] Agree on the UX of the `tap` operator
- [ ] Implement the `tap` operator
- [ ] Design user-interface additions for tapping
- [ ] Implement tapping in the app