search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
11.84k stars 3.12k forks source link

[opt](merge-on-write) Skip considering rowsets produced by compaction from commited txns' rowsets in publish phase #37242

Closed bobhan1 closed 2 days ago

bobhan1 commented 2 days ago

Proposed changes

https://github.com/apache/doris/pull/20907 let compaction calculates the delete bitmap of the output rowset from committed txns' rowsets to reduce the calculation pressure of publish phase. But this output rowset will be considered as new rowset in the publish phase and will be calculated again in the publish phase. This PR let the publish phase calculation skip considering these rowsets.

github-actions[bot] commented 2 days ago

clang-tidy review says "All clean, LGTM! :+1:"

dataroaring commented 2 days ago

run buildall