datastax / pulsar-helm-chart

Apache Pulsar Helm chart
Apache License 2.0
46 stars 38 forks source link

Activation state storage KO #228

Closed brunoflament closed 2 years ago

brunoflament commented 2 years ago

Hello,

The Bookie service is configured to listen on port 3181. What is port 3181 in bookie? Is it port 4181 instead?

apiVersion: v1
kind: Service
metadata:
  annotations:
    meta.helm.sh/release-name: pulsar
    meta.helm.sh/release-namespace: pulsar
  labels:
    app: pulsar
    app.kubernetes.io/managed-by: Helm
    chart: pulsar-2.9.3
    cluster: pulsar
    component: bookie
    heritage: Helm
    release: pulsar
  name: pulsar-bookie
  namespace: pulsar
spec:
  clusterIP: None
  clusterIPs:
  - None
  internalTrafficPolicy: Cluster
  ipFamilies:
  - IPv4
  ipFamilyPolicy: SingleStack
  ports:
  - name: bookie
    port: 3181
    protocol: TCP
    targetPort: 3181
  - name: http
    port: 8000
    protocol: TCP
    targetPort: 8000

https://pulsar.apache.org/docs/functions-worker#configure-stateful-functions-to-run-with-broker

michaeljmarshall commented 2 years ago

@brunoflament - port 4181 is only for stream storage on the bookkeeper. It is only enabled when .Values.extra.stateStorage or .Values.function.stateStorageUrlOverride are set. Port 3181 is the primary bookkeeper server used by brokers to store messages.

brunoflament commented 2 years ago

Activation function mode standalone + StateStorage

extra.function:true   #Activation function mode Standalone
broker.functionsWorkerEnabled: false  # Desactivation function in Broker
function.enableStateStorage: true   # Activation  StateStorage in Bookkepper
extra.stateStorage: false # Activation StateStorage not in Bookkeeper (add Bookkeeper extra ?)

Activation function in broker + StateStorage

broker.functionsWorkerEnabled: true
function.enableStateStorage: true
extra.function: false
extra.stateStorage: false