haoch / flink-siddhi

A CEP library to run Siddhi within Apache Flink™ Streaming Application (Not maintained)
Apache License 2.0
243 stars 96 forks source link

data ttl #48

Open xywan89 opened 5 years ago

xywan89 commented 5 years ago

we are using siddhi to process the realtime event collected online. i want to know the TTL of event processed. eg. when an event belong to stream testStream arrived,will the event always be available untill restart or shutdown siddhi cluster? if the event group by time window, the event will be discard once it is expired?

i guess the strategy above will affect something like memory use and the perfomance of docker run the siddhi.

haoch commented 4 years ago

The event will be removed after processed. For window/pattern, it will only keep necessary events in memory and while time moves or new events added, the expired events will be removed.