ArroyoSystems / arroyo

Distributed stream processing engine in Rust
https://arroyo.dev
Apache License 2.0
3.8k stars 220 forks source link

Add support for custom TTLs #741

Closed mwylde closed 2 months ago

mwylde commented 2 months ago

This PR adds initial support for custom state TTLs for updating aggregates and joins. Initially, these can only be applied on a pipeline-wide basis. A custom TTL can be set with a SET option, like

SET updating_ttl = '1 hour';

This will then override the default TTL of 24 hours for the pipeline.