delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
1.98k stars 365 forks source link

feat: add custom dynamodb endpoint configuration #2575

Closed hnaoto closed 3 weeks ago

hnaoto commented 3 weeks ago

Description

Add custom dynamodb endpoint configuration Users can specify dynamodb endpoint in the map or set the environment variable AWS_ENDPOINT_URL_DYNAMODB to override dynamodb client endpoint.

Related Issue(s)

2498

Documentation

github-actions[bot] commented 3 weeks ago

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

ion-elgreco commented 3 weeks ago

@hnaoto thanks!

ion-elgreco commented 3 weeks ago

@hnaoto can you also update the docs on s3 and dynamodb later on with this new change?

hnaoto commented 3 weeks ago

Thanks for reviewing the PR @ion-elgreco !

Yes, would you mind me asking where I can find the docs? Is it this one https://delta-io.github.io/delta-rs/usage/writing/writing-to-s3-with-locking-provider/ (for python)? The rust one is automatically generated. Is there another user guide for Rust?

ion-elgreco commented 3 weeks ago

@hnaoto that's the one yeah, you should see the related markdown file somewhere in the repo.

There is no specific guide for Rust, but this one is written generic enough. It's just that the example is often in Python