memiiso / debezium-server-iceberg

Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)
Apache License 2.0
174 stars 35 forks source link

Remove aws-java-sdk-bundle from release #204

Closed ismailsimsek closed 1 year ago

ismailsimsek commented 1 year ago

remove s3 bundle dependency which is very large in size.

as an alternative S3FileIO could be used this is the recommended file IO for s3.

S3FileIO adopts the latest AWS clients and S3 features for optimized security and performance and is thus recommended for S3 use cases rather than the S3A FileSystem.

further details: https://iceberg.apache.org/docs/1.4.0/aws/#s3-fileio

https://iceberg.apache.org/docs/1.4.0/aws/#hadoop-s3a-filesystem