delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
2.34k stars 414 forks source link

feat: override dynamodb config #3010

Closed thomas-chauvet closed 2 days ago

thomas-chauvet commented 2 days ago

Description

This PR add the possibility to override dynamoDB configuration via storage_options:

It solves cases where we use an S3-compatible storage without mutual exclusion but we want to use DynamoDB anyway as a locking provider. It also solves the case where we want to pass different credentials or region for S3 and dynamoDB.

Related Issue(s)

Documentation

Documentation has been updated to explain how to override configuration.

github-actions[bot] commented 2 days ago

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

thomas-chauvet commented 2 days ago

Issue with DCO, I'll re-open a PR ASAP.