When a pipeline behaves unexpectedly, users need to look into what's happening for their pipeline. For this, we want to add a feature that allows users to tap into the dataflow of pipelines.
This is a two-step process:
Implement a tap source operator that given a pipeline id and an operator id shows the data flowing out of that operator.
Design and implement how the user interacts with the tap operator in the app.
### Definition of Done
- [ ] Agree on the UX of the `tap` operator
- [ ] Implement the `tap` operator
- [ ] Design user-interface additions for tapping
- [ ] Implement tapping in the app
When a pipeline behaves unexpectedly, users need to look into what's happening for their pipeline. For this, we want to add a feature that allows users to tap into the dataflow of pipelines.
This is a two-step process:
tap
source operator that given a pipeline id and an operator id shows the data flowing out of that operator.tap
operator in the app.