search

AbsaOSS / spline

Data Lineage Tracking And Visualization Solution
https://absaoss.github.io/spline/
Apache License 2.0
596 stars 154 forks source link

Replace the Kafka Gateway with a new Kafka-to-REST adapter service #1121

Open wajda opened 1 year ago

wajda commented 1 year ago

It will make individual services more narrow focused and specialized. Kafka-to-REST bridge will simply pump Spline messages from a Kafka to the Producer REST API, that will become the main gate and will decouple Spline persistence layer from the transport layer.

wajda commented 11 months ago

After some discussions it is now not clear if it's actually a desired change. It would split the code nicely, but it could potentially add more latency due to longer message route. So I'll put it aside for now.