facebookincubator / velox

A composable and fully extensible C++ execution engine library for data management systems.
https://velox-lib.io/
Apache License 2.0
3.54k stars 1.17k forks source link

feat: Add indexed priority queue for auto writer thread scaling #11584

Closed xiaoxmeng closed 1 week ago

xiaoxmeng commented 1 week ago

Summary: Add indexed priority queue for table writer thread auto-scaling. The indexed priority queue organize the insert value by priority. It supports to (1) pop from the top of the queue, (2) update the existing value's priority and correspondingly adjusts its position in the queue. It support both min and max queue.

Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

netlify[bot] commented 1 week ago

Deploy Preview for meta-velox canceled.

Name Link
Latest commit e8257bdfd64176b9b919cf088c516e054f26ab85
Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/673d222e8b5bf1000849afd8
facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D66117014

facebook-github-bot commented 1 week ago

This pull request has been merged in facebookincubator/velox@b1069008c468ae110d87ec24400357ab3f3644fb.

conbench-facebook[bot] commented 1 week ago

Conbench analyzed the 1 benchmark run on commit b1069008.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.