ArroyoSystems / arroyo

Distributed stream processing engine in Rust
https://arroyo.dev
Apache License 2.0
3.81k stars 222 forks source link

State restoration in pipeline clusters #668

Closed mwylde closed 5 months ago

mwylde commented 5 months ago

This PR reworks the CLI interface for pipeline clusters and adds better support for running stateful pipelines using sqlite on runtimes like fargate.