search

reactive-ipc / reactive-ipc-jvm

Reactive IPC for the JVM
Apache License 2.0
55 stars 13 forks source link

Protocol: Kafka #6

Open benjchristensen opened 9 years ago

benjchristensen commented 9 years ago

I have a use case I need solved (Kafka) and would like to prove out the Reactive IPC design with it.

If we have a Netty 4 transport implementation and Reactive IPC API for TCP, I'd like to explore creating an ripc-kafka project/module that provides the Kafka protocols on top of the reactive TCP and exposes Reactive Streams APIs for Kafka. Then we can have ripc-kafka-rxjava1 which would provide exactly what I need.

One of the goals here is for a Kafka client to operate on the same transport as my other networking clients so I don't have different event loops for Kafka, Memcache, Cassandra, IPC, etc.

It will require the Kafka protocol being independent of transport implementation. This would be a positive outcome for the Kafka client as it would be core Java and allow any transport and any composition layer.

NiteshKant commented 9 years ago

:+1:

jbrisbin commented 9 years ago

I think this is a good idea that would get a lot of traction. It's also a good use case to keep in mind to guide what abstractions would be necessary to achieve this if not relying on Netty directly.