search

apache / iceberg-rust

Apache Iceberg
https://rust.iceberg.apache.org/
Apache License 2.0
477 stars 97 forks source link

Implement manifest filtering in `TableScan` #323

Closed sdd closed 2 months ago

sdd commented 3 months ago

This PR was broken out of https://github.com/apache/iceberg-rust/pull/241 as that PR was getting too large.

It builds on https://github.com/apache/iceberg-rust/pull/322, integrating the ManifestEvaluator from that PR into TableScan to perform the filtering capability provided by ManfestEvaluator on the manifest files in the manifest for the scan's snapshot, rejecting any manifests that don't match the table scan's filter predicate, if present.

liurenjie1024 commented 2 months ago

Let's wait a moment to see if others have comments.

liurenjie1024 commented 2 months ago

Thanks @sdd for this pr, and @Xuanwo @marvinlanhenke for review.