search

delta-incubator / delta-kernel-rs

A native Delta implementation for integration with any query engine
Apache License 2.0
137 stars 38 forks source link

Add `IS NOT NULL` to action read predicate in replay #143

Closed zachschuermann closed 1 month ago

zachschuermann commented 7 months ago

When reading actions in log replay we should add add.path IS NOT NULL and remove.path IS NOT NULL (and so on, for protocol/metadata too) to the predicate for pushdown to the scan for columns that survived pruning.

nicklan commented 1 month ago

closing as a duplicate of #74