search

apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.52k stars 1.29k forks source link

Add OOM query killing in multi-stage query engine #13433

Open gortiz opened 5 months ago

gortiz commented 5 months ago

Pinot has the ability to protect itself from OOM when executing heavy queries by enabling automatic query killing. But this feature is limited to single-stage queries.

We need to add support for multi-stage queries.

hpvd commented 5 months ago

@Jackie-Jiang what do think of introducing a new Resiliency label for issues like this one? Would be fitting to all issues making pinot more robust and give users a better more stable experience out of the box

edit: added a parent for issues of this type: https://github.com/apache/pinot/issues/13456

siddharthteotia commented 4 months ago

Yes Resiliency label would be useful. In fact, I think we have a bunch of resiliency related open / in-progress work that should ideally be coupled under resiliency label.