search

awslabs / aws-glue-schema-registry

AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema-registry.html to get started.
Apache License 2.0
130 stars 97 forks source link

Add support for retrieving the AWS glue schema information from message headers #296

Open vlidna opened 1 year ago

vlidna commented 1 year ago

Currently the AWSKafkaAvroSerializer/Deserializer encodes the schema version id into the body of the message. Now that Kafka supports message headers, it would be nice to support storing the schema version id in the message header for easier integration across languages that are not only using Java.

For example, I have producers and consumers in javascript and python and it is easier to just put the schema version id into the message header than it is to couple these to the mechanism used in the AWSKafkaAvroSerializer/Deserializer. If these supported setting and getting the schema version id in the message headers then I would not have to duplicate this serialization code in my various clients.

woile commented 1 year ago

I would love to have support for headers in the headers. And even better would be to have support for cloudevents. Are there any plans to do so?

blacktooth commented 1 year ago

And even better would be to have support for cloudevents

What do you mean by cloudevents? Can you please clarify?

OneCricketeer commented 1 year ago

https://github.com/cloudevents/spec/blob/main/cloudevents/formats/avro-format.md