search

redpanda-data / connect

Fancy stream processing made operationally mundane
https://docs.redpanda.com/redpanda-connect/about/
8.13k stars 835 forks source link

PubSub schema support in `schema_registry_encode` / `schema_registry_decode` #1095

Open disintegrator opened 2 years ago

disintegrator commented 2 years ago

This is a proposal to add support for PubSub schemas to schema_registry_encode / schema_registry_decode processors allowing for schema-driven processing of messages in the context of GCP projects. PubSub supports both Avro and Protobuf schemas.

disintegrator commented 2 years ago

I haven't worked out what the proposed configuration changes are for the processors. I will update the PR with a proposal when I've had time to research this problem some more.