nalgeon / redka

Redis re-implemented with SQLite
BSD 3-Clause "New" or "Revised" License
3.44k stars 94 forks source link

Redis Streams support #34

Open zahariash opened 2 weeks ago

zahariash commented 2 weeks ago

Are there a plans to implement streams?

Redka Streams would be perfect replacement for Redis Streams in many Kafka use cases where disk storage is required and/or memory is restricted.

nalgeon commented 2 weeks ago

No current plans. Would you personally use Redka in this use case?

zahariash commented 2 weeks ago

Yes, definitely.

Support for full streams API would allow me to switch from Kafka to Redka Streams for dev/ci/testing environments. Using Redis Streams currently doesn't have much sense to me, because of high requirements for a memory which is way more expensive than disk in a cloud. My use cases usually require long data retention but are fine with reduced performance.

nalgeon commented 2 weeks ago

If you only use Kafka in production (and Redis/Redka in dev/test), doesn't that mean that Kafka-related features don't get tested at all? Is that wise?

zahariash commented 2 weeks ago

I'm using te same protocol on all environments. Currently it's Kafka. I could switch to Redis/Redka streams everywhere, if Redka supports streams. Then I could use Redka for dev/testing and some managed Redis solution for production.

nalgeon commented 2 weeks ago

I see, thanks for the explanation! I will look into streams after the 1.0 release.

I'll leave the issue open to see if anyone else is interested in this feature.