delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
1.98k stars 365 forks source link

`raise_if_not_exists` for properties not configurable on CreateBuilder #2564

Closed vegarsti closed 3 weeks ago

vegarsti commented 4 weeks ago

The CreateBuilder calls apply_properties_to_protocol with raise_if_not_exists set to true. https://github.com/delta-io/delta-rs/blob/f2e30a0bbf58a3b56b2f912a02e10e7af0835301/crates/core/src/operations/create.rs#L282 This was introduced fairly recently, in https://github.com/delta-io/delta-rs/pull/2264.

Could we make raise_if_not_exists configurable on the builder? We are using the with_configuration to add some opaque configuration, using config keys that delta-rs doesn't know about, so we can't upgrade delta-rs.

(I'm pushing a PR for this now.)