numaproj / numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs
https://numaflow.numaproj.io/
Apache License 2.0
1.13k stars 113 forks source link

verify if the de-duplication logic is working as expected #1492

Open kohlisid opened 9 months ago

kohlisid commented 9 months ago

We need to verify the functionality of the Dedupe logic

Message from the maintainers:

Impacted by this bug? Give it a 👍. We often sort issues this way to know what to prioritize.

vigith commented 3 months ago

which de-duplication logic are we talking about here?