Currently, the only way to set a checkpoint interval is by passing in the checkpointIntervalMicros argument via the Arroyo API either when creating or updating the pipeline. However, when updating the pipeline, the pipeline doesn't dynamically update and only takes effect after a pipeline is stopped/started.
It would be nice to dynamically update the pipeline, so that the pipeline doesn't need to be stopped and started in order for the changes to occur.
mwylde
commented
1 month ago
Currently, the only way to set a checkpoint interval is by passing in the
checkpointIntervalMicrosargument via the Arroyo API either when creating or updating the pipeline. However, when updating the pipeline, the pipeline doesn't dynamically update and only takes effect after a pipeline is stopped/started.It would be nice to dynamically update the pipeline, so that the pipeline doesn't need to be stopped and started in order for the changes to occur.
(raised from Discord)