chore(query): improve distributed runtime filter - Githubissues

databendlabs / databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

https://docs.databend.com

Other

7.87k stars 751 forks source link

chore(query): improve distributed runtime filter #16862

Closed Dousir9 closed 3 days ago

Dousir9 commented 4 days ago

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

In distributed execution, in some cases the scan processor needs to wait for the runtime filter to be generated.

Benchmark

Databend Cloud Medium, TPC-H SF-100 Q17: 16.7s → 6s

Tests

[ ] Unit Test
[x] Logic Test
[ ] Benchmark Test
[ ] No Test - Explain why

Type of change

[ ] Bug Fix (non-breaking change which fixes an issue)
[ ] New Feature (non-breaking change which adds functionality)
[ ] Breaking Change (fix or feature that could cause existing functionality not to work as expected)
[ ] Documentation Update
[ ] Refactoring
[x] Performance Improvement
[ ] Other (please describe):

This change is

github-actions[bot] commented 4 days ago

Docker Image for PR

tag: pr-16862-97a030f-1731892791

note: this image tag is only available for internal use, please check the internal doc for more details.