search

AbsaOSS / hyperdrive

Extensible streaming ingestion pipeline on top of Apache Spark
Apache License 2.0
44 stars 13 forks source link

Feature/177 deduplicated kafka writer 2 #184

Closed kevinwallimann closed 3 years ago

kevinwallimann commented 3 years ago

Closes #177

The main logic is in DeduplicateKafkaSinkTransformer. I suggest starting there. The main test is in KafkaToKafkaDeduplicationAfterRetryDockerTest

sonarcloud[bot] commented 3 years ago

Kudos, SonarCloud Quality Gate passed!

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 3 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication