siddhi-io / siddhi

Stream Processing and Complex Event Processing Engine
http://siddhi.io
Apache License 2.0
1.52k stars 527 forks source link

Improve Persisted Aggregation IncrementalExecutorsInitialiser.recreateState Logic #1830

Closed Methma closed 5 months ago

Methma commented 7 months ago

Description: Recently we have encountered OOM in Analytics nodes after the restart while getting the upper and lower bound of EventTimestamps as we are trying to process all the events.

Error executing 'store_select_query_ApiUserPerAppAgg_DAYS', Java heap space. Hence, dropping event 'Event{***} io.siddhi.core.exception.OnDemandQueryRuntimeException: Error executing 'store_select_query_ApiUserPerAppAgg_DAYS', Java heap space at io.siddhi.core.query.SelectOnDemandQueryRuntime.execute(SelectOnDemandQueryRuntime.java:71) at io.siddhi.core.aggregation.IncrementalExecutorsInitialiser.recreateState(IncrementalExecutorsInitialiser.java:205)

Affected Siddhi Version: All