delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python

https://delta-io.github.io/delta-rs/

Apache License 2.0

2.21k stars 395 forks source link

Closed ion-elgreco closed 1 month ago

ion-elgreco commented 1 month ago

Description

Improved logic

If it's partition scan, we don't write CDC actions and data. CDF reader will use remove actions in this case now to know what's deleted or not
When the predicate doesn't hit a partition, we also write CDC data for the inserts

github-actions[bot] commented 1 month ago

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.