search

Azure / kafka-sink-azure-kusto

Kafka sink for Kusto
MIT License
48 stars 24 forks source link

KustoSinkConnector 2.1 Loads But Not Added #60

Closed nielsberglund closed 3 years ago

nielsberglund commented 3 years ago

I have built a Docker Image using the KustoSinConnector 2.0:

FROM confluentinc/cp-server-connect-base:6.2.0

COPY ./kafka-sink-azure-kusto-2.0.0-jar-with-dependencies.jar /usr/share/java
ENV CONNECT_CONNECTOR_CLIENT_CONFIG_OVERRIDE_POLICY=All
ENV CONNECT_SASL_MECHANISM=PLAIN
ENV CONNECT_SECURITY_PROTOCOL=SASL_SSL
ENV CONNECT_SSL_ENDPOINT_IDENTIFICATION_ALGORITHM=https
ENV CONNECT_SASL_JAAS_CONFIG="org.apache.kafka.common.security.plain.PlainLoginModule required username=\"somestuff\" password=\"somestuff\";"

I use the image in a Docker Compose file, and all is good. I can do a http://localhost:8083/connector-plugins and the connector is returned as being available. When looking in the in the Docker logs I see:

[2021-08-18 17:55:54,299] INFO Loading plugin from: /usr/share/java/kafka-sink-azure-kusto-2.0.0-jar-with-dependencies.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
[2021-08-18 17:55:54,554] INFO Registered loader: PluginClassLoader{pluginLocation=file:/usr/share/java/kafka-sink-azure-kusto-2.0.0-jar-with-dependencies.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
[2021-08-18 17:55:54,554] INFO Added plugin 'com.microsoft.azure.kusto.kafka.connect.sink.KustoSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
[2021-08-18 17:55:54,555] INFO Loading plugin from: /usr/share/java/acl (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)

As I said above, all good.

However, when I use the 2.1 version:

FROM confluentinc/cp-server-connect-base:6.2.0

COPY ./kafka-sink-azure-kusto-2.1.0-jar-with-dependencies.jar /usr/share/java
# with the ENV variables as above

I cannot see the connector when I do: http://localhost:8083/connector-plugins, and when I check the logs I see:

[2021-08-18 17:48:56,626] INFO Loading plugin from: /usr/share/java/kafka-sink-azure-kusto-2.1.0-jar-with-dependencies.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
[2021-08-18 17:48:56,893] INFO Registered loader: PluginClassLoader{pluginLocation=file:/usr/share/java/kafka-sink-azure-kusto-2.1.0-jar-with-dependencies.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
# NOTICE no Added plugin
[2021-08-18 17:48:56,894] INFO Loading plugin from: /usr/share/java/acl (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)

So the plugin loads, but is not added.

Am I doing something wrong, or?

ohadbitt commented 3 years ago

Hi sorry for the late response - please try now - the Uber JAR was created somehow without the connector itself