adobe / experience-platform-streaming-connect

Experience platform Streaming Connectors for Data Ingress

Apache License 2.0

23 stars 20 forks source link

ISSUE-36 Use kafka connect standard dead letter and logger error reporter #37

Closed vivetiwa closed 2 years ago

vivetiwa commented 2 years ago

Summary

Use kafka connect standard dead letter and logger error reporter in place of custom connector. No 2 separate configuration required, users will be able to use single kafka deadletter properties. Kafka connect dead letter configurations : https://docs.confluent.io/platform/current/connect/concepts.html#dead-letter-queue

Related Issue

36 Integrate AEP sink connector with deadletter implementation provided by Kafka

Changes

Removed custom error handling
Use standard kafka deadletter error handling
Removed kafka connect internal api usage

Relevant Documentation

How Has This Been Tested?

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to change)

Checklist

[x] I have signed the Adobe Open Source CLA.
[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.