Add Kafka Connect Avro Converter for Schema Registry

Azure / azure-schema-registry-for-kafka

Kafka support for Azure Schema Registry.

https://aka.ms/schemaregistry

MIT License

13 stars 20 forks source link

Add Kafka Connect Avro Converter for Schema Registry #37

Closed nickghardwick closed 1 year ago

nickghardwick commented 1 year ago

This pull request adds an Avro Converter for Kafka Connect to allow use of the Azure Schema Registry in sending and receiving data in Kafka via Kafka Connect

Implements base Converter interface to convert objects to and from native Connect Data
Adds configuration files for configuring Azure Schema Registry Avro serializer, deserializer, and converter
Adds simple unit tests for serializer and deserializer

imrohankataria commented 1 year ago

Any updates on this? @hmlam

hmlam commented 1 year ago

Any updates on this? @hmlam

Given the dependency on an external package, we are working with our legal team to make sure this dependency is ok.

nickghardwick commented 1 year ago

After cleaning up the POM files, I think it might make sense to keep the Avro converter as a separate package. In order for a user to add it to their Kafka Connect project, they would need to clone and build the files in this folder into a jar file and add it as an external plugin. This is easier to do if the custom converter package is created on top of the existing serializes but published separately.