search

jcustenborder / kafka-config-provider-azure

5 stars 5 forks source link

Plugin incompatible with Kafka Connect Docker image #3

Open wildnothing opened 2 years ago

wildnothing commented 2 years ago

Confluent Docker image confluentinc/cp-kafka-connect:7.1.1 requires worker properties to be set via the following mechanism

ENV CONNECT_CONFIG_PROVIDERS "keyVault"
ENV CONNECT_CONFIG_PROVIDERS_KEYVAULT_CLASS "com.github.jcustenborder.kafka.config.azure.KeyVaultConfigProvider"

This adds the following two properties to /etc/kafka-connect/kafka-connect.properties as follows

config.providers=keyVault
config.providers.keyvault.class=com.github.jcustenborder.kafka.config.azure.KeyVaultConfigProvider
...

However, due to the nature of Connect's AbstractConfig.java, the values of these properties are never found because they require a key of config.providers.keyVault.class whereas Docker serialises the key as config.providers.keyvault.class instead.

jcustenborder commented 2 years ago

The provider tag is whatever you want to use. You could use it lowercase.

ENV CONNECT_CONFIG_PROVIDERS "keyvault"

wildnothing commented 2 years ago

The provider tag is whatever you want to use. You could use it lowercase.

ENV CONNECT_CONFIG_PROVIDERS "keyvault"

We tried that but unfortunately we also had change every class which had "KeyVault" in its name to "Keyvault" instead. Only after this did we get it working.