databendlabs / databend

๐——๐—ฎ๐˜๐—ฎ, ๐—”๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ & ๐—”๐—œ. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.71k stars 732 forks source link

chore(storage): refactor compact source #16527

Open zhyass opened 18 hours ago

zhyass commented 18 hours ago

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

split compactsource to CompactSource and CompactTransform, use PrefetchAsyncSource.

Move build_compact_source into pipelines builder.

Tests

Type of change


This change isโ€‚Reviewable