apache / iceberg-rust

Apache Iceberg
https://rust.iceberg.apache.org/
Apache License 2.0
592 stars 134 forks source link

Feature: S3 Remote Signing #506

Open c-thiel opened 1 month ago

c-thiel commented 1 month ago

Currently we do not respect the s3.remote-signing* attributes in FileIO. It would be great to support remote-signing for access federation to MinIO like storages.

Follow-up of https://github.com/apache/iceberg-rust/pull/505

Xuanwo commented 1 month ago

Copied my reply for this feature below:

I checked how iceberg-java implemetns remote-signing:

https://github.com/apache/iceberg/blob/f7585932a6d89b04c0d45b5f9dfe6f45483efd0b/aws/src/main/java/org/apache/iceberg/aws/s3/signer/S3V4RestSignerClient.java#L65-L76

It seems we need to implement this signer in iceberg-rust and pass it as a customized signer to opendal.

flaneur2020 commented 1 month ago

can i take this issue?

Xuanwo commented 1 month ago

Of course, welcome!