bitnami / charts

Bitnami Helm Charts
https://bitnami.com
Other
9.02k stars 9.22k forks source link

[bitnami/kafka] How can I set the "advertised.listener" for each broker with server.config? #7291

Closed midi79 closed 3 years ago

midi79 commented 3 years ago

Which chart: Kafka

Is your feature request related to a problem? Please describe. I am trying to install the kafka in the Kubernetes cluster which has three brokers. And I'd like to add to "advertised.listener" for each broker's "server.config" file. However, I cannot add that config when the kafka starts. I added "Value.yaml" which has options for "advertised.listener", but it didn't work. When I added the "advertised.listener=XXXXXX" in the config option, the brokers didn't run. And I tried to add the "advertisedListeners:" option, but it also didn't work. I saw the additional options generated dynamically on the "setup.sh" file when I install or upgrade helm chart. BUT, the "setup.sh" script didn't execute when the kafka broker started. How can I add the advertised.listener option for each broker?

Describe the solution you'd like The "setup.sh" script have to run when the broker start.

Describe alternatives you've considered When I install or upgrade the helm chart, the helm should make "server.config" file dynamically with "advertised.listener=XXXXXX"

Additional context Add any other context or screenshots about the feature request here.

pablogalegoc commented 3 years ago

Hi @midi79!

Could you share the parameters you are setting on the values.yaml file? Thanks!

midi79 commented 3 years ago

@pablogalegoc I really appreciate your help! Here is our "value.yaml" file. Its name was modified because yaml file shouldn't upload directly. Please check it.

values.txt

pablogalegoc commented 3 years ago

@midi79 sorry for the late response, have you tried setting the advertisedListeners like this:

advertisedListeners:
  - "INTERNAL://test:9093"
  - "CLIENT://test:9092"

I can see them being picked by the kafka pod:

❯ kubectl describe pod/kafka-0 | grep KAFKA_CFG_ADVERTISED_LISTENERS
      KAFKA_CFG_ADVERTISED_LISTENERS:                      INTERNAL://test:9093,CLIENT://test:9092
github-actions[bot] commented 3 years ago

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

github-actions[bot] commented 3 years ago

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.

akshaysolank commented 1 year ago

Hi, Team I am also facing the same issue could you please explain to me a bit more details that what I have to add to my Kafka value.yaml file to connect it conduktor

listeners: []
advertisedListeners: []
listenerSecurityProtocolMap: ""
allowPlaintextListener: true
interBrokerListenerName: INTERNAL

these below are my pods

kafka-0                         1/1     Running     0          4h32m
kafka-1                         1/1     Running     0          2m19s
kafka-2                         1/1     Running     0          3m7s
kafka-client                    1/1     Running     0          3d4h
zookeeper-0                     1/1     Running     0          2d1h
zookeeper-1                     1/1     Running     0          2d1h
zookeeper-2                     1/1     Running     0          2d1h

and these are my svc

kafka                ClusterIP   a.b.c.d    <none>        9092/TCP                     4h51m
kafka-headless       ClusterIP   None             <none>        9092/TCP,9093/TCP            4h51m
zookeeper            ClusterIP   w.x.y.z   <none>        2181/TCP,2888/TCP,3888/TCP   2d5h
zookeeper-headless   ClusterIP   None             <none>        2181/TCP,2888/TCP,3888/TCP   2d5h
carrodher commented 1 year ago

Could you please create a new issue filling the template with your specific scenario so we can provide better support? Thanks in advance