siddhi-io / siddhi

Stream Processing and Complex Event Processing Engine
http://siddhi.io
Apache License 2.0
1.52k stars 527 forks source link

Improve aggregation initialisation #1837

Closed YasasRangika closed 5 months ago

YasasRangika commented 6 months ago

Purpose

To handle the possible OOM issue in Analytics nodes when processing non-aggregated data while starting the server.

Goals

Fixes: https://github.com/siddhi-io/siddhi/issues/1830

Approach

Improved aggregation initialization by limiting the number of columns loaded to the in-memory for Persisted aggregation.

Original PR: https://github.com/wso2-support/siddhi/pull/257

CLAassistant commented 6 months ago

CLA assistant check
All committers have signed the CLA.