robinhood / faust

Python Stream Processing
Other
6.73k stars 535 forks source link

redis streams #151

Open trbck opened 6 years ago

trbck commented 6 years ago

Hi, any thoughts on replacing kafka with redis streams?

vineetgoel commented 6 years ago

We definitely would like to add additional transports to Faust, in addition to Kafka, though this is not immediate priority for us.

That being said, on a quick look at RedisStreams, it looks like it doesn't contain some of the neat partitioning features (and a few other features) that Kafka has which would make it a bit difficult to add all the features of Faust when using RedisStreams.