databendlabs / databend

๐——๐—ฎ๐˜๐—ฎ, ๐—”๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ & ๐—”๐—œ. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.85k stars 750 forks source link

refactor(query): make delta table support partition prunning #16621

Closed sundy-li closed 4 weeks ago

sundy-li commented 1 month ago

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

  1. make delta table support partition prunning
  2. simplify hive table, remove parquet2 codes in hive table
  3. fix ut bug

Tests

Type of change

closes #16624


This change isโ€‚Reviewable

Xuanwo commented 1 month ago

Can we share the same thing in iceberg later?

sundy-li commented 1 month ago

Can we share the same thing in iceberg later?

Yes, maybe next pr. We already have PartitionPruner in common crate now.

Xuanwo commented 1 month ago

That's great!