databendlabs / databend

๐——๐—ฎ๐˜๐—ฎ, ๐—”๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ & ๐—”๐—œ. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.85k stars 750 forks source link

refactor(query): use arrow-flight to exchange datas #16657

Closed sundy-li closed 3 weeks ago

sundy-li commented 3 weeks ago

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Migrate exchange common-arrow flight to arrow-flight.

Note: This change is incompatible if you are running nodes with old versions and new versions in the same cluster, because the old version does not recognize the new compression types.

You can use set global query_flight_compression = 'none' if you still want to have different query version nodes in the same cluster.

Tests

Type of change


This change isโ€‚Reviewable

github-actions[bot] commented 3 weeks ago

Docker Image for PR

note: this image tag is only available for internal use, please check the internal doc for more details.

github-actions[bot] commented 3 weeks ago

ClickBench Report