TU-Berlin-DIMA / scotty-window-processor

This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.
https://tu-berlin-dima.github.io/scotty-window-processor/
Apache License 2.0
75 stars 23 forks source link

Out-of-order processing Demo and Workaround to resend Windows in Allowed Lateness #48

Closed julianev closed 2 years ago

julianev commented 2 years ago

Implements test cases to demonstrate out-of-order processing and adds architecture document for processing out-of-order tuples in allowed lateness.

Implements workaround to return windows from allowed lateness until lastWatermark again, if an out-of-order tuple in allowed lateness has arrived. Variable resendWindowsInAllowedLateness can be set to true by function setResendWindowsInAllowedLateness in SlicingWindowOperator at initialization. Upon the arrival of an out-of-order tuple in allowed lateness, lastWatermark is set to allowed lateness.