DataCater / datacater

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
https://datacater.io
Other
82 stars 4 forks source link

fix(ui): Always show fields that are transformed #105

Closed flippingbits closed 1 year ago

flippingbits commented 1 year ago

We automatically profile the schema of records by inspecting the results of the pipeline preview.

If pipeline drops fields or entire records, we previously have not been able to render fields that defined a transform or filter, making it hard to users to revert them.

With this fix, we automatically add fields, which define a transform or filter, to the profiled schema of the records, enabling users to always change any part of the pipeline, regardless of whether the preview returns records or not.

Before this fix, the grid would stay completely empty and uneditable, if all records have been filtered out: Screenshot 2022-12-21 at 16 19 31

With this fix, we still show the field that applies the filter, allowing users to potentially remove the filter again: Screenshot 2022-12-21 at 16 19 45

sonarcloud[bot] commented 1 year ago

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information