Open dantengsky opened 2 weeks ago
pr-15382-6ac94f2
note: this image tag is only available for internal use, please check the internal doc for more details.
pr-15382-3037a5f
note: this image tag is only available for internal use, please check the internal doc for more details.
@xudong963 Thanks for helping me review this PR; really appreciate it. Let me try to make further adjustments to avoid using the bloom filter in situations where false positives could nearly make bloom pruning ineffective.
I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/
Summary
Implements runtime pruning for probe-side data blocks by utilizing the runtime filter (based on the min-max filter) and the bloom filter index of the probe table.
replace range filter expression with
eq
filter expressions if min equals max while constructing the min-max filtersthe
eq
filter expression is compatible with both rangeindex and bloom indexduring runtime filtering (of probe side data), if runtime min-max pruning failed, the bloom filter will be tried.
add new profile metric
RuntimeBloomFilterPrunedParts
, which records the number of blocks pruned by bloom filterFixes #[Link the issue here]
Tests
Type of change
This change isโ