search

confluentinc / ksql

The database purpose-built for stream processing applications.
https://ksqldb.io
Other
44 stars 1.04k forks source link

Support non-SchemaRegistry PROTOBUF serialization/deserialization #8853

Closed ddai23 closed 2 years ago

ddai23 commented 2 years ago

Is your feature request related to a problem? Please describe. Schema Registry is required in ksqlDB for Protobuf deserialization.

Describe the solution you'd like Supports map<topic, protobuf_definition> in parameters to ksqlDB cluster, and deserialize given Protobufs in corresponding topics without needing Schema Registry.

Describe alternatives you've considered

Additional context We can't upgrade the input data to be schema-id encoded, and managing the additional SchemaRegistry cluster is an overhead for only a handful of static PROTOBUFs.

suhas-satish commented 2 years ago

prioritizing this for Q2. cc: @Gerrrr