ArroyoSystems / arroyo

Distributed stream processing engine in Rust
https://arroyo.dev
Apache License 2.0
3.8k stars 220 forks source link

Upgrade kinesis dependency to avoid multiple AWS client versions #747

Closed mwylde closed 1 month ago

mwylde commented 1 month ago

This should speed up compilation and reduce binary size (as aws-client is one of our slowest to compile and biggest dependencies).

Also refactors the flushing logic a bit to use our new retry! macro, and fixes a regression from 0.10 that could cause failed flushes if a batch was too big.