Aiven-Open / tiered-storage-for-apache-kafka

RemoteStorageManager for Apache Kafka® Tiered Storage
Apache License 2.0
95 stars 20 forks source link

Add experimental SOCKS5 support for S3 #524

Open ivanyu opened 7 months ago

ivanyu commented 7 months ago

Technically, I found a way to have proxy-side host name resolution, but it requires rewriting quite a bit of the AWS client machinery. Leaving it as is for now.

ivanyu commented 7 months ago

@jeqo I isolated all the reflection operations in a separate package + added a comment on this. Even when this becomes non-experimental, most likely the reflection magic stays: the AWS SDK isn't just configurable enough to do what we want as we did with the other clouds.