DataCater / datacater

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
https://datacater.io
Other
82 stars 4 forks source link

fix(ui): Correctly reset transforms #53

Closed flippingbits closed 1 year ago

flippingbits commented 1 year ago

When removing a transform in the UI-based pipeline designer, we previously set the transform key to an empty string, which produced pipeline YAMLs like the following one:

spec:
  steps:
    fields:
      email:
        transform:
          key: "hash"
      name:
        transform:
          key: ""

These pipeline YAMLs failed when being evaluated with the Python runner since the runner could not find a transform with an empty key.

This commity changes this behavior and lets the pipeline designer correctly remove the transforms from the YAML, producing pipeline YAML that can be processed by the Python runner, e.g.:

spec:
  steps:
    fields:
      email:
        transform:
          key: "hash"
sonarcloud[bot] commented 1 year ago

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information