delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
2.33k stars 411 forks source link

feat: improved test fixtures #2749

Closed roeap closed 3 months ago

roeap commented 3 months ago

Description

This PR is mainly preparation for the work we need to do on data skipping. It intorduces a new set of test utilities, but at least also gets rid of one other "test_utils" file. Over the next few PRs I hope to gradually consolidate our usage on "Localized" test utitlitis and use the shared ones.

Initially I wanted to place this in the test crate, but somehow cargo kept on complaining about version conflicts, regarding the action structs.

We also add a function to get the partition values schema on snapshot, which I forgot to remove in rebasing some commits. WE will need it going forward so I was hoping it does not add too much complexity to this PR.