I've been trying to setup the iceber-sink-connector in confluent cloud with glue catalog, which requires me to configure AWS access key and secret access key. Is it possible to provide these credentials through some configuration property? I tried iceberg.catalog.s3.access-key-id and iceberg.catalog.s3.secret-access-key but it didn't work for glue catalog. Here are my configuration properties for the connector:
Setting up the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY would probably solve my issue, but I don't have the option to set it as I'm running this connector as a custom connector in confluent cloud. I also do not get control over the connect workers that run this connector. How can I provide the AWS credentials?
I've been trying to setup the iceber-sink-connector in confluent cloud with glue catalog, which requires me to configure AWS access key and secret access key. Is it possible to provide these credentials through some configuration property? I tried
iceberg.catalog.s3.access-key-id
andiceberg.catalog.s3.secret-access-key
but it didn't work for glue catalog. Here are my configuration properties for the connector:Setting up the environment variables
AWS_ACCESS_KEY_ID
andAWS_SECRET_ACCESS_KEY
would probably solve my issue, but I don't have the option to set it as I'm running this connector as a custom connector in confluent cloud. I also do not get control over the connect workers that run this connector. How can I provide the AWS credentials?Any help on this is much appreciated, thank you!