Closed freeformz closed 11 months ago
Moin, the error you're getting here is with the configuration, do you mind sharing your config with us? this would certainly help to evaluate what might be happening.
btw, re MSK custom integration, some context look at #458
ssl.truststore.location=/usr/local/opt/openjdk/libexec/openjdk.jdk/Contents/Home/lib/security/cacerts
security.protocol=SASL_SSL
sasl.mechanism=AWS_MSK_IAM
sasl.jaas.config=software.amazon.msk.auth.iam.IAMLoginModule required;
sasl.client.callback.handler.class=software.amazon.msk.auth.iam.IAMClientCallbackHandler
This is the same config that I am using post bundling and with the standard kafka tools.
The following configs worked in my case when access MSK with IAM auth client.properties
security.protocol=SASL_SSL
sasl.mechanism=AWS_MSK_IAM
sasl.jaas.config=software.amazon.msk.auth.iam.IAMLoginModule required;
sasl.client.callback.handler.class=software.amazon.msk.auth.iam.IAMClientCallbackHandler
topology.topic.prefix.format={{topic}}
topology.project.prefix.format=
app.sh
set -e
JULIE_OPS_HOME=/usr/local/julie-ops
JULIE_OPS_JAR=$JULIE_OPS_HOME/bin/julie-ops.jar
java -cp aws-msk-iam-auth.jar:$JULIE_OPS_JAR com.purbon.kafka.topology.CommandLineInterface --topology descriptor.yaml --clientConfig client.properties --brokers $MSK_BBROKERS
exec "$@"
Describe the bug A clear and concise description of what the bug is.
To Reproduce Steps to reproduce the behavior:
java -cp ~/jars/aws-msk-iam-auth-1.1.4-all.jar -jar ~/jars/julie-ops.jar ....
Expected behavior I expected adding the
aws-msk-iam-auth
to the classpath to work.Essentially I expected this to work
java -cp ~/jars/aws-msk-iam-auth-1.1.4-all.jar -jar ~/jars/julie-ops.jar ....
Screenshots If applicable, add screenshots to help explain your problem.
Runtime (please complete the following information):
Additional context
I pulled apart the julie-ops.jar file and found some stuff already in
software/amazon/
and I think that is confusing the class loader. I am no java expert though. I checked the repo out and applied this patch and the new jar works without having to add the aws-msk-iam-auth jar to the classpath (because it's part of the julie-ops jar)