feat: Add priority based memory reclaim framework

facebookincubator / velox

A composable and fully extensible C++ execution engine library for data management systems.

https://velox-lib.io/

Apache License 2.0

3.54k stars 1.17k forks source link

Open tanjialiang opened 1 week ago

tanjialiang commented 1 week ago

Adds priority base reclaiming to memory reclaim framework. The priority determines which memory pool to reclaim first on the same level. This would help to make reclaim more application logic aware.
Make join node reclaim priority lower than others. This is because cost of reclaiming (spilling) on join node is high compared to other nodes.

netlify[bot] commented 1 week ago

Name	Link
Latest commit	e352ec740a09c7eeadd9d6f1b900d96a5a22e5ac
Latest deploy log	https://app.netlify.com/sites/meta-velox/deploys/6744dce0a166170008f3f4ef

facebook-github-bot commented 1 week ago

@tanjialiang has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.