search

takebayashi / fluent-plugin-avro

MIT License
12 stars 15 forks source link

How to insert Confluent magic bytes 0-4 for Schema Registry id? #11

Open DaveSlinn opened 5 years ago

DaveSlinn commented 5 years ago

We are successfully formatting our message to Kafka using the fluentd-plugin-kafka and this formatter plugin, but we would like to have it send the avro record to Kafka with the 5 "magic" bytes as defined by Confluent for associated the avro messages with a schema in the schema registry.

https://docs.confluent.io/current/schema-registry/serializer-formatter.html#wire-format

Is this possible?

takebayashi commented 5 years ago

No, custom prefixes/suffixes such as Confluent's wire format are not currently supported in this plugin.

avandych commented 4 years ago

will it be supported?

DaveSlinn commented 4 years ago

My teammate forked this repo and added the ability to specify the schemaid in the fluent config here https://github.com/mstinglin/fluent-plugin-avro