search

ConduitIO / conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
https://conduit.io
Apache License 2.0
363 stars 42 forks source link

[Schemas] Use configured schema service in Avro processors #1653

Open hariso opened 2 weeks ago

hariso commented 2 weeks ago

Part of #1560.

With schema support in Conduit, we come to the questions:

hariso commented 2 weeks ago

Comment by @lovromazgon:

Not for this PR, but I'll mention it before I forget. I realized that having a builtin schema registry could create the expectation that the avro.decode and avro.encode processors would be able to use the internal schema registry. It would be a bit strange if we had to configure Conduit to point to a schema registry and then again supply the URL to the processors separately. So ideally the processors should use this service to create and get schemas. Not sure if this was included in the design or not.

https://github.com/ConduitIO/conduit/pull/1605#discussion_r1635023006