rohits123
commented
10 months ago Update:
I have tried a separate mount path like below:
zeebe:
pvcAccessModes:
- ReadWriteMany
pvcStorageClassName: "efs-sc"
env:
- name: ZEEBE_BROKER_EXPORTERS_KAFKAEXPORTER_CLASSNAME
value: au.th.zeebe.boundary.CamundaExporter
- name: ZEEBE_BROKER_EXPORTERS_KAFKAEXPORTER_JARPATH
value: /tmp/zeebe-kafka-exporter.jar
initContainers:
- name: init-exporters-kafka
image: amazon/aws-cli:2.15.8
securityContext:
runAsNonRoot: true
runAsUser: 1000
command: ["sh", "-c", "ls -ltr /tmp && aws s3 cp s3://my-bucket/polaris-zeebe-exporter-1.0.0.jar /tmp/zeebe-kafka-exporter.jar && ls -al /tmp"]
volumeMounts:
- name: exporters-zeebe
mountPath: /tmp/
env:
- name: AWS_ACCESS_KEY_ID
valueFrom:
secretKeyRef:
name: my-secret
key: access-key-id
- name: AWS_SECRET_ACCESS_KEY
valueFrom:
secretKeyRef:
name: my-secret
key: secret-access-key
extraVolumes:
- name: exporters-zeebe
emptyDir: {}
extraVolumeMounts:
- name: exporters-zeebe
mountPath: /tmpBut it fails to load exporter
+ export ZEEBE_BROKER_CLUSTER_NODEID=2 │
│ + ZEEBE_BROKER_CLUSTER_NODEID=2 │
│ ++ ls -A /exporters/ │
│ + '[' '' ']' │
│ + echo 'No exporters available.' │
│ + exec /usr/local/zeebe/bin/broker │
│ No exporters available. │
│ Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/local/zeebe/data -XX:ErrorFile=/usr/local/zeebe/data/zeebe_error%p.log -XX:+ExitOnOutOfMemoryError │
│ ______ ______ ______ ____ ______ ____ _____ ____ _ __ ______ _____ │
│ |___ / | ____| | ____| | _ \ | ____| | _ \ | __ \ / __ \ | |/ / | ____| | __ \ │
│ / / | |__ | |__ | |_) | | |__ | |_) | | |__) | | | | | | ' / | |__ | |__) | │
│ / / | __| | __| | _ < | __| | _ < | _ / | | | | | < | __| | _ / │
│ / /__ | |____ | |____ | |_) | | |____ | |_) | | | \ \ | |__| | | . \ | |____ | | \ \ │
│ /_____| |______| |______| |____/ |______| |____/ |_| \_\ \____/ |_|\_\ |______| |_| \_\ │
│ │
│ 2024-01-12 05:46:14.070 [] [main] [] INFO │
│ io.camunda.zeebe.broker.StandaloneBroker - Starting StandaloneBroker v8.3.3 using Java 17.0.9 with PID 7 (/usr/local/zeebe/lib/camunda-zeebe-8.3.3.jar started by zeebe in /usr/local/zeebe) │
│ 2024-01-12 05:46:14.074 [] [main] [] INFO │
│ io.camunda.zeebe.broker.StandaloneBroker - The following 1 profile is active: "broker" │
│ 2024-01-12 05:46:18.803 [] [main] [] INFO │
│ org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 10 endpoint(s) beneath base path '/actuator' │
│ 2024-01-12 05:46:19.668 [] [main] [] INFO │
│ org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 9600 │
│ 2024-01-12 05:46:19.682 [] [main] [] INFO │
│ io.camunda.zeebe.broker.StandaloneBroker - Started StandaloneBroker in 6.711 seconds (process running for 8.973) │
│ 2024-01-12 05:46:19.687 [] [main] [] WARN │
│ io.camunda.zeebe.broker.system - No backup store is configured. Backups will not be taken │
│ 2024-01-12 05:46:19.886 [] [main] [] INFO │
│ org.springframework.boot.autoconfigure.logging.ConditionEvaluationReportLogger - │
│ │
│ Error starting ApplicationContext. To display the condition evaluation report re-run your application with 'debug' enabled. │
│ 2024-01-12 05:46:19.959 [] [main] [] ERROR │
│ org.springframework.boot.SpringApplication - Application run failed │
│ java.lang.IllegalStateException: Failed to execute CommandLineRunner │
│ at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:774) ~[spring-boot-3.1.5.jar:3.1.5] │
│ at org.springframework.boot.SpringApplication.lambda$callRunners$3(SpringApplication.java:755) [spring-boot-3.1.5.jar:3.1.5] │
│ at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Unknown Source) ~[?:?] │
│ at java.util.stream.SortedOps$SizedRefSortingSink.end(Unknown Source) ~[?:?] │
│ at java.util.stream.AbstractPipeline.copyInto(Unknown Source) ~[?:?] │
│ at java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source) ~[?:?] │
│ at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(Unknown Source) ~[?:?] │
│ at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(Unknown Source) ~[?:?] │
│ at java.util.stream.AbstractPipeline.evaluate(Unknown Source) ~[?:?] │
│ at java.util.stream.ReferencePipeline.forEach(Unknown Source) ~[?:?] │
│ at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:750) [spring-boot-3.1.5.jar:3.1.5] │
│ at org.springframework.boot.SpringApplication.run(SpringApplication.java:323) [spring-boot-3.1.5.jar:3.1.5] │
│ at io.camunda.zeebe.broker.StandaloneBroker.main(StandaloneBroker.java:78) [camunda-zeebe-8.3.3.jar:8.3.3] │
│ Caused by: java.lang.IllegalStateException: Failed to load exporter with configuration: ExporterCfg{, jarPath='/tmp/zeebe-kafka-exporter.jar', className='au.th.zeebe.boundary.CamundaExporter', args=null}
Caused by: java.lang.IllegalStateException: Failed to load exporter with configuration: ExporterCfg{, jarPath='/tmp/zeebe-kafka-exporter.jar', className='au.th.zeebe.boundary.CamundaExporter', args=null} │
│ at io.camunda.zeebe.broker.Broker.buildExporterRepository(Broker.java:149) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.Broker.<init>(Broker.java:70) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.Broker.<init>(Broker.java:49) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.StandaloneBroker.run(StandaloneBroker.java:87) ~[camunda-zeebe-8.3.3.jar:8.3.3] │
│ at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:771) ~[spring-boot-3.1.5.jar:3.1.5] │
│ ... 12 more │
│ Caused by: io.camunda.zeebe.util.jar.ExternalJarLoadException: Cannot load JAR at [/tmp/zeebe-kafka-exporter.jar]: is not readable │
│ at io.camunda.zeebe.util.jar.ExternalJarRepository.verifyJarPath(ExternalJarRepository.java:78) ~[zeebe-util-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.util.jar.ExternalJarRepository.load(ExternalJarRepository.java:54) ~[zeebe-util-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.util.jar.ExternalJarRepository.load(ExternalJarRepository.java:47) ~[zeebe-util-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.exporter.repo.ExporterRepository.load(ExporterRepository.java:75) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.Broker.buildExporterRepository(Broker.java:147) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.Broker.<init>(Broker.java:70) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.Broker.<init>(Broker.java:49) ~[zeebe-broker-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.StandaloneBroker.run(StandaloneBroker.java:87) ~[camunda-zeebe-8.3.3.jar:8.3.3] │
│ at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:771) ~[spring-boot-3.1.5.jar:3.1.5] │
│ ... 12 more │
│ 2024-01-12 05:46:19.969 [] [main] [] WARN │
│ org.springframework.boot.web.reactive.context.AnnotationConfigReactiveWebServerApplicationContext - Exception thrown from ApplicationListener handling ContextClosedEvent │
│ java.lang.NullPointerException: Cannot invoke "io.camunda.zeebe.broker.Broker.close()" because "this.broker" is null │
│ at io.camunda.zeebe.broker.StandaloneBroker.onApplicationEvent(StandaloneBroker.java:94) ~[camunda-zeebe-8.3.3.jar:8.3.3] │
│ at io.camunda.zeebe.broker.StandaloneBroker.onApplicationEvent(StandaloneBroker.java:34) ~[camunda-zeebe-8.3.3.jar:8.3.3] │
│ at org.springframework.context.event.SimpleApplicationEventMulticaster.doInvokeListener(SimpleApplicationEventMulticaster.java:174) ~[spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:167) ~[spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:145) ~[spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:445) ~[spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:378) ~[spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1067) [spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.boot.web.reactive.context.ReactiveWebServerApplicationContext.doClose(ReactiveWebServerApplicationContext.java:149) [spring-boot-3.1.5.jar:3.1.5] │
│ at org.springframework.context.support.AbstractApplicationContext.close(AbstractApplicationContext.java:1035) [spring-context-6.0.13.jar:6.0.13] │
│ at org.springframework.boot.SpringApplication.handleRunFailure(SpringApplication.java:790) [spring-boot-3.1.5.jar:3.1.5] │
│ at org.springframework.boot.SpringApplication.run(SpringApplication.java:329) [spring-boot-3.1.5.jar:3.1.5] │
│ at io.camunda.zeebe.broker.StandaloneBroker.main(StandaloneBroker.java:78) [camunda-zeebe-8.3.3.jar:8.3.3] │
│ 2024-01-12 05:46:19.971 [] [main] [] INFO │
│ org.springframework.boot.web.embedded.netty.GracefulShutdown - Commencing graceful shutdown. Waiting for active requests to complete │
│ 2024-01-12 05:46:19.973 [] [netty-shutdown] [] INFO │
│ org.springframework.boot.web.embedded.netty.GracefulShutdown - Graceful shutdown complete │
│ 2024-01-12 05:46:20.047 [] [atomix-cluster-0] [] INFO │
│ io.atomix.cluster.AtomixCluster - Stopped 
aabouzaid
npepinpe
Describe the issue:
I am adding custom kafka exporter the "Adding dynamic exporters to Zeebe Broker" - way, using Helm charts (version 8.3.3) into Kubernetes. Zeebe config in values file
Actual behavior:
Expected behavior:
The custom kafka exporter integration should work
How to reproduce:
Logs:
zeebe pod logs:
initcontainer logs:
Environment:
Please note: Without the following info, it's hard to resolve the issue and probably it will be closed.