getsentry / arroyo

A library to build streaming applications that consume from and produce to Kafka.
https://getsentry.github.io/arroyo/
Apache License 2.0
39 stars 6 forks source link

Add flexible Reduce strategy type #333

Closed cmanallen closed 5 months ago

cmanallen commented 5 months ago

The pull is documented in the code. Its more contextual to read the reasoning there. Mostly the buffer protocol and the flush method. The buffer impl is totally independent of Arroyo/Kafka all the rest. You can write a buffer with no knowledge of where it will be used.