camunda / camunda

Process Orchestration Framework
https://camunda.com/platform/
3.22k stars 590 forks source link

io.camunda.zeebe.test.OldGatewayTest unstable #7133

Closed Zelldon closed 4 months ago

Zelldon commented 3 years ago

Summary

Try to answer the following as best as possible

Failures

Outline known failure cases, e.g. a failed assertion and its stacktrace obtained from Jenkins

Example assertion failure
org.awaitility.core.ConditionTimeoutException: Condition with alias 'until element task is in state CREATED' didn't complete within 5 seconds because condition with lambda expression in io.camunda.zeebe.test.UpdateTestCaseProvider that uses io.camunda.zeebe.test.ContainerState, io.camunda.zeebe.test.ContainerStatejava.lang.String, java.lang.Stringjava.lang.String was not fulfilled.
    at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:26)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:864)
    at io.camunda.zeebe.test.UpdateTestCaseProvider.awaitElementInState(UpdateTestCaseProvider.java:357)
    at io.camunda.zeebe.test.UpdateTestCaseProvider.activateJob(UpdateTestCaseProvider.java:193)
    at io.camunda.zeebe.test.UpdateTestCase.runBefore(UpdateTestCase.java:45)
    at io.camunda.zeebe.test.OldGatewayTest.update(OldGatewayTest.java:55)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)
    at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
    at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
    at org.junit.jupiter.engine.extension.TimeoutInvocation.proceed(TimeoutInvocation.java:46)
    at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)
    at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)
    at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92)
    at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)
    at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)
    at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
    at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
    at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
    at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
    at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)
    at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)
    at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)
    at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)
    at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
    at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:185)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService.submit(ForkJoinPoolHierarchicalTestExecutorService.java:118)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask$DefaultDynamicTestExecutor.execute(NodeTestTask.java:212)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask$DefaultDynamicTestExecutor.execute(NodeTestTask.java:192)
    at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:139)
    at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.lambda$execute$2(TestTemplateTestDescriptor.java:107)
    at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:177)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
    at java.base/java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:442)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
    at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
    at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:274)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
    at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
    at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
    at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
    at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:274)
    at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
    at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
    at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
    at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
    at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:107)
    at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:42)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
    at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:185)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService.invokeAll(ForkJoinPoolHierarchicalTestExecutorService.java:129)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
    at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:185)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService.invokeAll(ForkJoinPoolHierarchicalTestExecutorService.java:129)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
    at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
    at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
    at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
    at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:185)
    at java.base/java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)

Hypotheses

List any hypotheses if you have one; can be ommitted Idk

Logs

If possible, provide more context here, e.g. standard output logs, link to build, etc.

Logs
16:50:15.469 [ForkJoinPool-1-worker-3] [] WARN  org.testcontainers.utility.TestcontainersConfiguration - Attempted to read Testcontainers configuration file at file:/root/.testcontainers.properties but the file was not found. Exception message: FileNotFoundException: /root/.testcontainers.properties (No such file or directory)
16:50:15.552 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.dockerclient.DockerMachineClientProviderStrategy - docker-machine executable was not found on PATH ([/usr/local/openjdk-11/bin, /usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin])
16:50:18.985 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.dockerclient.DockerClientProviderStrategy - Found Docker environment with Environment variables, system properties and defaults. Resolved dockerHost=tcp://localhost:2375
16:50:19.047 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - Docker host IP address is localhost
16:50:19.148 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - Connected to docker: 
  Server Version: 20.10.5
  API Version: 1.41
  Operating System: Alpine Linux v3.13 (containerized)
  Total Memory: 120871 MB
16:50:19.160 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.utility.ImageNameSubstitutor - Image name substitution will be performed by: DefaultImageNameSubstitutor (composite of 'ConfigurationFileImageNameSubstitutor' and 'PrefixingImageNameSubstitutor')
16:50:19.252 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.utility.RegistryAuthLocator - Failure when attempting to lookup auth config. Please ignore if you don't have images in an authenticated registry. Details: (dockerImageName: testcontainers/ryuk:0.3.1, configFile: /root/.docker/config.json. Falling back to docker-java default behaviour. Exception message: /root/.docker/config.json (No such file or directory)
16:50:20.379 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Starting to pull image
16:50:20.419 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  0 pending,  0 downloaded,  0 extracted, (0 bytes/0 bytes)
16:50:20.427 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  2 pending,  1 downloaded,  0 extracted, (55 KB/? MB)
16:50:20.433 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  1 pending,  2 downloaded,  0 extracted, (55 KB/? MB)
16:50:20.445 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  0 pending,  3 downloaded,  0 extracted, (59 KB/5 MB)
16:50:20.588 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  0 pending,  3 downloaded,  1 extracted, (2 MB/5 MB)
16:50:20.740 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  0 pending,  3 downloaded,  2 extracted, (2 MB/5 MB)
16:50:20.899 [docker-java-stream-1336992916] [] INFO  org.testcontainers.DockerClientFactory - Pulling image layers:  0 pending,  3 downloaded,  3 extracted, (5 MB/5 MB)
16:50:21.934 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - Ryuk started - will monitor and terminate Testcontainers containers on JVM exit
16:50:21.935 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - Checking the system...
16:50:21.936 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - ✔︎ Docker server version should be at least 1.6.0
16:50:22.043 [ForkJoinPool-1-worker-3] [] INFO  org.testcontainers.DockerClientFactory - ✔︎ Docker environment should have more than 2GB free disk space
16:50:22.138 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:current-test] - Creating container for image: camunda/zeebe:current-test
16:50:25.349 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:current-test] - Starting container with ID: 70bff46ed93c3673921fca3f9ad4d170cbb1fc64a15a8d3b5fca6946ed550f95
16:50:26.061 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:current-test] - Container camunda/zeebe:current-test is starting: 70bff46ed93c3673921fca3f9ad4d170cbb1fc64a15a8d3b5fca6946ed550f95
16:50:41.715 [ducttape-0] [] INFO  org.testcontainers.containers.wait.strategy.HttpWaitStrategy - /naughty_greider: Waiting for 60 seconds for URL: http://localhost:49165/ready (where port 49165 maps to container port 9600)
16:50:43.468 [ducttape-0] [] INFO  io.zeebe.containers.ZeebeTopologyWaitStrategy - /naughty_greider: Waiting for PT1M for topology to have at least 1 brokers, 1 partitions with 1 replicas, and each partition to have a leader
16:50:44.668 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:current-test] - Container camunda/zeebe:current-test started in PT22.545735S
16:50:44.673 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:1.0.0] - Pulling docker image: camunda/zeebe:1.0.0. Please be patient; this may take some time but only needs to be done once.
16:50:46.392 [docker-java-stream-1194756946] [] INFO  🐳 [camunda/zeebe:1.0.0] - Starting to pull image
16:50:46.394 [docker-java-stream-1194756946] [] INFO  🐳 [camunda/zeebe:1.0.0] - Pulling image layers:  0 pending,  0 downloaded,  0 extracted, (0 bytes/0 bytes)
16:50:48.203 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:1.0.0] - Creating container for image: camunda/zeebe:1.0.0
16:50:48.992 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:1.0.0] - Starting container with ID: 2a92d86e33de6ae5efddc6822ce1649ec345e8bfa2f9d5c829377147c342733d
16:50:51.863 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:1.0.0] - Container camunda/zeebe:1.0.0 is starting: 2a92d86e33de6ae5efddc6822ce1649ec345e8bfa2f9d5c829377147c342733d
16:51:00.994 [ducttape-0] [] INFO  io.zeebe.containers.ZeebeTopologyWaitStrategy - /epic_shirley: Waiting for PT1M for topology to have at least 1 brokers, 1 partitions with 1 replicas, and each partition to have a leader
16:51:02.074 [ForkJoinPool-1-worker-3] [] INFO  🐳 [camunda/zeebe:1.0.0] - Container camunda/zeebe:1.0.0 started in PT17.403845S
16:51:12.277 [ForkJoinPool-1-worker-3] [] ERROR io.camunda.zeebe.test.ContainerState - 
===============================================
Broker logs
===============================================
++ hostname -i
+ HOST=172.19.0.2
+ '[' false = true ']'
+ export ZEEBE_BROKER_NETWORK_HOST=0.0.0.0
+ ZEEBE_BROKER_NETWORK_HOST=0.0.0.0
+ export ZEEBE_BROKER_GATEWAY_CLUSTER_HOST=0.0.0.0
+ ZEEBE_BROKER_GATEWAY_CLUSTER_HOST=0.0.0.0
+ exec /usr/local/zeebe/bin/broker
  ______  ______   ______   ____    ______     ____    _____     ____    _  __  ______   _____  
 |___  / |  ____| |  ____| |  _ \  |  ____|   |  _ \  |  __ \   / __ \  | |/ / |  ____| |  __ \ 
    / /  | |__    | |__    | |_) | | |__      | |_) | | |__) | | |  | | | ' /  | |__    | |__) |
   / /   |  __|   |  __|   |  _ <  |  __|     |  _ <  |  _  /  | |  | | |  <   |  __|   |  _  / 
  / /__  | |____  | |____  | |_) | | |____    | |_) | | | \ \  | |__| | | . \  | |____  | | \ \ 
 /_____| |______| |______| |____/  |______|   |____/  |_|  \_\  \____/  |_|\_\ |______| |_|  \_\

2021-05-26 16:50:28.049 [] [main] INFO 
      io.camunda.zeebe.broker.StandaloneBroker - Starting StandaloneBroker v1.1.0-SNAPSHOT using Java 11.0.11 on 70bff46ed93c with PID 7 (/usr/local/zeebe/lib/camunda-cloud-zeebe-1.1.0-SNAPSHOT.jar started by root in /usr/local/zeebe)
2021-05-26 16:50:28.057 [] [main] DEBUG
      io.camunda.zeebe.broker.StandaloneBroker - Running with Spring Boot v2.4.5, Spring v5.3.7
2021-05-26 16:50:28.058 [] [main] INFO 
      io.camunda.zeebe.broker.StandaloneBroker - No active profile set, falling back to default profiles: default
2021-05-26 16:50:29.454 [] [main] INFO 
      org.springframework.boot.web.embedded.tomcat.TomcatWebServer - Tomcat initialized with port(s): 9600 (http)
2021-05-26 16:50:29.466 [] [main] INFO 
      org.apache.coyote.http11.Http11NioProtocol - Initializing ProtocolHandler ["http-nio-0.0.0.0-9600"]
2021-05-26 16:50:29.467 [] [main] INFO 
      org.apache.catalina.core.StandardService - Starting service [Tomcat]
2021-05-26 16:50:29.468 [] [main] INFO 
      org.apache.catalina.core.StandardEngine - Starting Servlet engine: [Apache Tomcat/9.0.45]
2021-05-26 16:50:29.569 [] [main] INFO 
      org.apache.catalina.core.ContainerBase.[Tomcat].[localhost].[/] - Initializing Spring embedded WebApplicationContext
2021-05-26 16:50:29.569 [] [main] INFO 
      org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext - Root WebApplicationContext: initialization completed in 1464 ms
2021-05-26 16:50:30.256 [] [main] INFO 
      org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 4 endpoint(s) beneath base path '/actuator'
2021-05-26 16:50:30.282 [] [main] INFO 
      org.apache.coyote.http11.Http11NioProtocol - Starting ProtocolHandler ["http-nio-0.0.0.0-9600"]
2021-05-26 16:50:30.301 [] [main] INFO 
      org.springframework.boot.web.embedded.tomcat.TomcatWebServer - Tomcat started on port(s): 9600 (http) with context path ''
2021-05-26 16:50:30.317 [] [main] INFO 
      io.camunda.zeebe.broker.StandaloneBroker - Started StandaloneBroker in 2.802 seconds (JVM running for 4.247)
2021-05-26 16:50:30.355 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Initializing system with base path /usr/local/zeebe
2021-05-26 16:50:30.428 [] [main] INFO 
      io.camunda.zeebe.broker.system - Version: 1.1.0-SNAPSHOT
2021-05-26 16:50:30.484 [] [main] INFO 
      io.camunda.zeebe.broker.system - Starting broker 0 with configuration {
  "network" : {
    "host" : "0.0.0.0",
    "portOffset" : 0,
    "maxMessageSize" : "128KB",
    "advertisedHost" : "tc-w4Er4nPM",
    "commandApi" : {
      "host" : "0.0.0.0",
      "port" : 26501,
      "advertisedHost" : "tc-w4Er4nPM",
      "advertisedPort" : 26501,
      "address" : "0.0.0.0:26501",
      "advertisedAddress" : "tc-w4Er4nPM:26501"
    },
    "internalApi" : {
      "host" : "0.0.0.0",
      "port" : 26502,
      "advertisedHost" : "tc-w4Er4nPM",
      "advertisedPort" : 26502,
      "address" : "0.0.0.0:26502",
      "advertisedAddress" : "tc-w4Er4nPM:26502"
    },
    "monitoringApi" : {
      "host" : "0.0.0.0",
      "port" : 9600,
      "advertisedHost" : "tc-w4Er4nPM",
      "advertisedPort" : 9600,
      "address" : "0.0.0.0:9600",
      "advertisedAddress" : "tc-w4Er4nPM:9600"
    },
    "maxMessageSizeInBytes" : 131072
  },
  "cluster" : {
    "initialContactPoints" : [ ],
    "partitionIds" : [ 1 ],
    "nodeId" : 0,
    "partitionsCount" : 1,
    "replicationFactor" : 1,
    "clusterSize" : 1,
    "clusterName" : "zeebe-cluster",
    "membership" : {
      "broadcastUpdates" : false,
      "broadcastDisputes" : true,
      "notifySuspect" : false,
      "gossipInterval" : "PT0.25S",
      "gossipFanout" : 2,
      "probeInterval" : "PT1S",
      "probeTimeout" : "PT0.1S",
      "suspectProbes" : 3,
      "failureTimeout" : "PT10S",
      "syncInterval" : "PT10S"
    }
  },
  "threads" : {
    "cpuThreadCount" : 2,
    "ioThreadCount" : 2
  },
  "data" : {
    "directory" : "/usr/local/zeebe/data",
    "logSegmentSize" : "64MB",
    "snapshotPeriod" : "PT1M",
    "logIndexDensity" : 1,
    "diskUsageMonitoringEnabled" : true,
    "diskUsageReplicationWatermark" : 0.99,
    "diskUsageCommandWatermark" : 0.97,
    "diskUsageMonitoringInterval" : "PT1S",
    "logSegmentSizeInBytes" : 67108864,
    "freeDiskSpaceCommandWatermark" : 3037238723,
    "freeDiskSpaceReplicationWatermark" : 1012412908
  },
  "exporters" : {
    "DebugLogExporter" : {
      "jarPath" : null,
      "className" : "io.camunda.zeebe.broker.exporter.debug.DebugLogExporter",
      "args" : null,
      "external" : false
    }
  },
  "gateway" : {
    "network" : {
      "host" : "0.0.0.0",
      "port" : 26500,
      "minKeepAliveInterval" : "PT30S"
    },
    "cluster" : {
      "contactPoint" : "0.0.0.0:26502",
      "requestTimeout" : "PT15S",
      "clusterName" : "zeebe-cluster",
      "memberId" : "gateway",
      "host" : "0.0.0.0",
      "port" : 26502,
      "membership" : {
        "broadcastUpdates" : false,
        "broadcastDisputes" : true,
        "notifySuspect" : false,
        "gossipInterval" : "PT0.25S",
        "gossipFanout" : 2,
        "probeInterval" : "PT1S",
        "probeTimeout" : "PT0.1S",
        "suspectProbes" : 3,
        "failureTimeout" : "PT10S",
        "syncInterval" : "PT10S"
      }
    },
    "threads" : {
      "managementThreads" : 1
    },
    "monitoring" : {
      "enabled" : false,
      "host" : "0.0.0.0",
      "port" : 9600
    },
    "security" : {
      "enabled" : false,
      "certificateChainPath" : null,
      "privateKeyPath" : null
    },
    "longPolling" : {
      "enabled" : true
    },
    "initialized" : true,
    "enable" : true
  },
  "backpressure" : {
    "enabled" : true,
    "algorithm" : "VEGAS",
    "aimd" : {
      "requestTimeout" : "PT1S",
      "initialLimit" : 100,
      "minLimit" : 1,
      "maxLimit" : 1000,
      "backoffRatio" : 0.9
    },
    "fixed" : {
      "limit" : 20
    },
    "vegas" : {
      "alpha" : 3,
      "beta" : 6,
      "initialLimit" : 20
    },
    "gradient" : {
      "minLimit" : 10,
      "initialLimit" : 20,
      "rttTolerance" : 2.0
    },
    "gradient2" : {
      "minLimit" : 10,
      "initialLimit" : 20,
      "rttTolerance" : 2.0,
      "longWindow" : 600
    }
  },
  "experimental" : {
    "maxAppendsPerFollower" : 2,
    "maxAppendBatchSize" : "32KB",
    "disableExplicitRaftFlush" : false,
    "rocksdb" : {
      "columnFamilyOptions" : { },
      "enableStatistics" : false,
      "memoryLimit" : "512MB",
      "maxOpenFiles" : -1,
      "maxWriteBufferNumber" : 6,
      "minWriteBufferNumberToMerge" : 3,
      "ioRateBytesPerSecond" : 0,
      "disableWal" : false
    },
    "maxAppendBatchSizeInBytes" : 32768
  },
  "stepTimeout" : "PT5M",
  "executionMetricsExporterEnabled" : false
}
2021-05-26 16:50:30.514 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [1/14]: actor scheduler
2021-05-26 16:50:30.518 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [1/14]: actor scheduler started in 2 ms
2021-05-26 16:50:30.518 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [2/14]: membership and replication protocol
2021-05-26 16:50:30.693 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [2/14]: membership and replication protocol started in 173 ms
2021-05-26 16:50:30.693 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [3/14]: command api transport
2021-05-26 16:50:30.986 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26501
2021-05-26 16:50:30.992 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - Started
2021-05-26 16:50:30.993 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bound command API to [0.0.0.0:26501], using advertised address tc-w4Er4nPM:26501 
2021-05-26 16:50:31.004 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [3/14]: command api transport started in 311 ms
2021-05-26 16:50:31.005 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [4/14]: command api handler
2021-05-26 16:50:31.039 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [4/14]: command api handler started in 34 ms
2021-05-26 16:50:31.039 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [5/14]: subscription api
2021-05-26 16:50:31.065 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [5/14]: subscription api started in 26 ms
2021-05-26 16:50:31.066 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [6/14]: cluster services
2021-05-26 16:50:31.066 [] [main] INFO 
      io.atomix.core.Atomix - 1.1.0-SNAPSHOT (revision e5f1e5 built on 2021-05-26 16:44:58)
2021-05-26 16:50:31.081 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26502
2021-05-26 16:50:31.082 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - Started
2021-05-26 16:50:31.131 [] [netty-unicast-event-nio-client-0] INFO 
      io.atomix.cluster.messaging.impl.NettyUnicastService - UDP server listening for connections on 0.0.0.0:26502
2021-05-26 16:50:31.132 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.discovery.BootstrapDiscoveryProvider - Joined
2021-05-26 16:50:31.136 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.protocol.SwimMembershipProtocol - Started
2021-05-26 16:50:31.137 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.impl.DefaultClusterMembershipService - Started
2021-05-26 16:50:31.137 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.messaging.impl.DefaultClusterCommunicationService - Started
2021-05-26 16:50:31.138 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.messaging.impl.DefaultClusterEventService - Started
2021-05-26 16:50:31.145 [] [atomix-0] INFO 
      io.atomix.raft.partition.impl.RaftPartitionServer - RaftPartitionServer{raft-partition-partition-1} - Starting server for partition PartitionId{id=1, group=raft-partition}
2021-05-26 16:50:33.176 [] [atomix-0] DEBUG
      io.camunda.zeebe.journal.file.SegmentedJournal - Created segment: JournalSegment{id=1, index=1}
2021-05-26 16:50:34.722 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to FOLLOWER
2021-05-26 16:50:34.725 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.roles.FollowerRole - RaftServer{raft-partition-partition-1}{role=FOLLOWER} - Single member cluster. Transitioning directly to candidate.
2021-05-26 16:50:34.726 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to CANDIDATE
2021-05-26 16:50:34.726 [] [raft-server-0-raft-partition-partition-1] WARN 
      io.atomix.utils.event.ListenerRegistry - Listener io.atomix.raft.roles.FollowerRole$$Lambda$1032/0x00000008406e3c40@3bdc6ca6 not registered
2021-05-26 16:50:34.728 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.roles.CandidateRole - RaftServer{raft-partition-partition-1}{role=CANDIDATE} - Single member cluster. Transitioning directly to leader.
2021-05-26 16:50:38.191 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to LEADER
2021-05-26 16:50:39.143 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Found leader 0
2021-05-26 16:50:41.078 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Setting firstCommitIndex to 1. RaftServer is ready only after it has committed events upto this index
2021-05-26 16:50:41.324 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.impl.DefaultRaftServer - RaftServer{raft-partition-partition-1} - Server join completed. Waiting for the server to be READY
2021-05-26 16:50:41.325 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.partition.impl.RaftPartitionServer - RaftPartitionServer{raft-partition-partition-1} - Successfully started server for partition PartitionId{id=1, group=raft-partition} in 10180ms
2021-05-26 16:50:41.326 [] [raft-server-0-raft-partition-partition-1] INFO 
      io.atomix.raft.partition.RaftPartitionGroup - Started
2021-05-26 16:50:41.327 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [6/14]: cluster services started in 10260 ms
2021-05-26 16:50:41.327 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [7/14]: topology manager
2021-05-26 16:50:41.328 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [7/14]: topology manager started in 1 ms
2021-05-26 16:50:41.328 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [8/14]: embedded gateway
2021-05-26 16:50:41.336 [] [main] INFO 
      io.camunda.zeebe.gateway - Version: 1.1.0-SNAPSHOT
2021-05-26 16:50:41.343 [] [main] INFO 
      io.camunda.zeebe.gateway - Starting gateway with configuration {
  "network" : {
    "host" : "0.0.0.0",
    "port" : 26500,
    "minKeepAliveInterval" : "PT30S"
  },
  "cluster" : {
    "contactPoint" : "0.0.0.0:26502",
    "requestTimeout" : "PT15S",
    "clusterName" : "zeebe-cluster",
    "memberId" : "gateway",
    "host" : "0.0.0.0",
    "port" : 26502,
    "membership" : {
      "broadcastUpdates" : false,
      "broadcastDisputes" : true,
      "notifySuspect" : false,
      "gossipInterval" : "PT0.25S",
      "gossipFanout" : 2,
      "probeInterval" : "PT1S",
      "probeTimeout" : "PT0.1S",
      "suspectProbes" : 3,
      "failureTimeout" : "PT10S",
      "syncInterval" : "PT10S"
    }
  },
  "threads" : {
    "managementThreads" : 1
  },
  "monitoring" : {
    "enabled" : false,
    "host" : "0.0.0.0",
    "port" : 9600
  },
  "security" : {
    "enabled" : false,
    "certificateChainPath" : null,
    "privateKeyPath" : null
  },
  "longPolling" : {
    "enabled" : true
  },
  "initialized" : true,
  "enable" : true
}
2021-05-26 16:50:41.351 [GatewayTopologyManager] [Broker-0-zb-actors-0] DEBUG
      io.camunda.zeebe.gateway - Received new broker BrokerInfo{nodeId=0, partitionsCount=1, clusterSize=1, replicationFactor=1, partitionRoles={}, partitionLeaderTerms={}, partitionHealthStatuses={}, version=1.1.0-SNAPSHOT}.
2021-05-26 16:50:41.472 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [8/14]: embedded gateway started in 144 ms
2021-05-26 16:50:41.472 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [9/14]: monitoring services
2021-05-26 16:50:41.476 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [9/14]: monitoring services started in 4 ms
2021-05-26 16:50:41.476 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [10/14]: disk space monitor
2021-05-26 16:50:41.478 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [10/14]: disk space monitor started in 1 ms
2021-05-26 16:50:41.479 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [11/14]: leader management request handler
2021-05-26 16:50:41.479 [GatewayTopologyManager] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.gateway - Received metadata change from Broker 0, partitions {}, terms {} and health {}.
2021-05-26 16:50:41.483 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [11/14]: leader management request handler started in 4 ms
2021-05-26 16:50:41.483 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [12/14]: zeebe partitions
2021-05-26 16:50:41.487 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 partitions [1/1]: partition 1
2021-05-26 16:50:41.502 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.broker.system - Partition role transitioning from null to LEADER in term 1
2021-05-26 16:50:41.503 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.broker.system - Partition 1 closed all previous open resources, before transitioning.
2021-05-26 16:50:41.517 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.broker.system - Detected 'HEALTHY' components. The current health status of components: {logstream-raft-partition-partition-1=HEALTHY}
2021-05-26 16:50:41.884 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.logstreams.snapshot - Opened database from '/usr/local/zeebe/data/raft-partition/partitions/1/runtime'.
2021-05-26 16:50:41.933 [Broker-0-LogStream-1] [Broker-0-zb-actors-0] DEBUG
      io.camunda.zeebe.logstreams - Configured log appender back pressure at partition 1 as AppenderVegasCfg{initialLimit=1024, maxConcurrency=32768, alphaLimit=0.7, betaLimit=0.95}. Window limiting is disabled
2021-05-26 16:50:41.947 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.logstreams - Recovering state of partition 1 from snapshot
2021-05-26 16:50:42.126 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] INFO 
      org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.el.impl.feel.MessagePackValueMapper@7fadaca0)), function-provider: io.camunda.zeebe.el.impl.feel.FeelFunctionProvider@26f28d05, clock: io.camunda.zeebe.el.impl.ZeebeFeelEngineClock@3e1dfd2, configuration: Configuration(false)]
2021-05-26 16:50:42.281 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] INFO 
      io.camunda.zeebe.logstreams - Recovered state of partition 1 from snapshot at position -1
2021-05-26 16:50:42.293 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] INFO 
      org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.el.impl.feel.MessagePackValueMapper@3fa1dc4f)), function-provider: io.camunda.zeebe.el.impl.feel.FeelFunctionProvider@3d11be89, clock: io.camunda.zeebe.el.impl.ZeebeFeelEngineClock@1868e2fc, configuration: Configuration(false)]
2021-05-26 16:50:42.309 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] INFO 
      org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.el.impl.feel.MessagePackValueMapper@521785e)), function-provider: io.camunda.zeebe.el.impl.feel.FeelFunctionProvider@11ad43db, clock: io.camunda.zeebe.el.impl.ZeebeFeelEngineClock@20fa14c, configuration: Configuration(false)]
2021-05-26 16:50:42.313 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-1] INFO 
      org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.el.impl.feel.MessagePackValueMapper@55305c1d)), function-provider: io.camunda.zeebe.el.impl.feel.FeelFunctionProvider@28e863c3, clock: io.camunda.zeebe.el.impl.ZeebeFeelEngineClock@7c08c7ca, configuration: Configuration(false)]
2021-05-26 16:50:42.411 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter - Recovering exporter from snapshot
2021-05-26 16:50:42.412 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG
      io.camunda.zeebe.broker.system - Partition 1 transition complete, installed 12 resources!
2021-05-26 16:50:42.416 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter - Recovered exporter 'Broker-0-Exporter-1' from snapshot at lastExportedPosition -1
2021-05-26 16:50:42.417 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter - Configure exporter with id 'DebugLogExporter'
2021-05-26 16:50:42.420 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter - Set event filter for exporters: ExporterEventFilter{acceptRecordTypes={EVENT=true, COMMAND=true, COMMAND_REJECTION=true, NULL_VAL=true, SBE_UNKNOWN=true}, acceptValueTypes={JOB=true, MESSAGE_START_EVENT_SUBSCRIPTION=true, TIMER=true, ERROR=true, INCIDENT=true, PROCESS_MESSAGE_SUBSCRIPTION=true, VARIABLE_DOCUMENT=true, PROCESS_INSTANCE_RESULT=true, NULL_VAL=true, JOB_BATCH=true, MESSAGE_SUBSCRIPTION=true, PROCESS_INSTANCE=true, SBE_UNKNOWN=true, MESSAGE=true, VARIABLE=true, PROCESS_INSTANCE_CREATION=true, PROCESS_EVENT=true, DEPLOYMENT=true, PROCESS=true, DEPLOYMENT_DISTRIBUTION=true}}
2021-05-26 16:50:42.420 [Broker-0-HealthCheckService] [Broker-0-zb-actors-0] DEBUG
      io.camunda.zeebe.broker.system - All partitions are installed. Broker is ready!
2021-05-26 16:50:42.422 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter - Open exporter with id 'DebugLogExporter'
2021-05-26 16:50:42.422 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - Debug exporter opened
2021-05-26 16:50:42.422 [Broker-0-HealthCheckService] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.broker.system - Detected 'HEALTHY' components. The current health status of components: {Partition-1=HEALTHY}
2021-05-26 16:50:42.423 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 partitions [1/1]: partition 1 started in 936 ms
2021-05-26 16:50:42.423 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 partitions succeeded. Started 1 steps in 937 ms.
2021-05-26 16:50:42.423 [Broker-0-HealthCheckService] [Broker-0-zb-actors-1] INFO 
      io.camunda.zeebe.broker.system - Partition-1 recovered, marking it as healthy
2021-05-26 16:50:42.423 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [12/14]: zeebe partitions started in 940 ms
2021-05-26 16:50:42.423 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [13/14]: register diskspace usage listeners
2021-05-26 16:50:42.424 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [13/14]: register diskspace usage listeners started in 0 ms
2021-05-26 16:50:42.424 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [14/14]: upgrade manager
2021-05-26 16:50:42.425 [] [main] DEBUG
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 [14/14]: upgrade manager started in 1 ms
2021-05-26 16:50:42.425 [] [main] INFO 
      io.camunda.zeebe.broker.system - Bootstrap Broker-0 succeeded. Started 14 steps in 11912 ms.
2021-05-26 16:50:42.482 [GatewayTopologyManager] [Broker-0-zb-actors-1] DEBUG
      io.camunda.zeebe.gateway - Received metadata change from Broker 0, partitions {1=LEADER}, terms {1=1} and health {1=HEALTHY}.
2021-05-26 16:50:42.760 [] [http-nio-0.0.0.0-9600-exec-2] INFO 
      org.apache.catalina.core.ContainerBase.[Tomcat].[localhost].[/] - Initializing Spring DispatcherServlet 'dispatcherServlet'
2021-05-26 16:50:42.761 [] [http-nio-0.0.0.0-9600-exec-2] INFO 
      org.springframework.web.servlet.DispatcherServlet - Initializing Servlet 'dispatcherServlet'
2021-05-26 16:50:42.762 [] [http-nio-0.0.0.0-9600-exec-2] INFO 
      org.springframework.web.servlet.DispatcherServlet - Completed initialization in 1 ms
2021-05-26 16:51:03.278 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-1] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"resources":[{"resource":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiIHN0YW5kYWxvbmU9Im5vIj8+CjxkZWZpbml0aW9ucyB4bWxuczpicG1uZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvREkiIHhtbG5zOmRjPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9ERC8yMDEwMDUyNC9EQyIgeG1sbnM6ZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0RELzIwMTAwNTI0L0RJIiB4bWxuczpuczA9Imh0dHA6Ly9jYW11bmRhLm9yZy9zY2hlbWEvemVlYmUvMS4wIiBpZD0iZGVmaW5pdGlvbnNfYTc2N2M0ZGYtNDVjNy00ZWY2LTgxZWQtZGUxNzhjYTRhODNjIiB0YXJnZXROYW1lc3BhY2U9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvTU9ERUwiIHhtbG5zPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9CUE1OLzIwMTAwNTI0L01PREVMIj4KICA8cHJvY2VzcyBpZD0icHJvY2VzcyIgaXNFeGVjdXRhYmxlPSJ0cnVlIj4KICAgIDxzdGFydEV2ZW50IGlkPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyI+CiAgICAgIDxvdXRnb2luZz5zZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0PC9vdXRnb2luZz4KICAgIDwvc3RhcnRFdmVudD4KICAgIDxzZXJ2aWNlVGFzayBpZD0idGFzayIgbmFtZT0idGFzayI+CiAgICAgIDxleHRlbnNpb25FbGVtZW50cz4KICAgICAgICA8bnMwOnRhc2tEZWZpbml0aW9uIHR5cGU9InRhc2siLz4KICAgICAgPC9leHRlbnNpb25FbGVtZW50cz4KICAgICAgPGluY29taW5nPnNlcXVlbmNlRmxvd19kM2YxMWUxZC04N2E0LTRjMDctOGI5NC1hYmUxMmQ5OGM1MjQ8L2luY29taW5nPgogICAgICA8b3V0Z29pbmc+c2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZDwvb3V0Z29pbmc+CiAgICA8L3NlcnZpY2VUYXNrPgogICAgPHNlcXVlbmNlRmxvdyBpZD0ic2VxdWVuY2VGbG93X2QzZjExZTFkLTg3YTQtNGMwNy04Yjk0LWFiZTEyZDk4YzUyNCIgc291cmNlUmVmPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyIgdGFyZ2V0UmVmPSJ0YXNrIi8+CiAgICA8ZW5kRXZlbnQgaWQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSI+CiAgICAgIDxpbmNvbWluZz5zZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkPC9pbmNvbWluZz4KICAgIDwvZW5kRXZlbnQ+CiAgICA8c2VxdWVuY2VGbG93IGlkPSJzZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkIiBzb3VyY2VSZWY9InRhc2siIHRhcmdldFJlZj0iZW5kRXZlbnRfYzU4YzA0YTYtZTU0Mi00OWM0LTg5NzMtODU4NzNjZWVmM2Y1Ii8+CiAgPC9wcm9jZXNzPgogIDxicG1uZGk6QlBNTkRpYWdyYW0gaWQ9IkJQTU5EaWFncmFtXzM5ZTQxNzVlLTQxNDMtNGU5MC04ZjQxLWY2NGVhMGU4ZDUyOSI+CiAgICA8YnBtbmRpOkJQTU5QbGFuZSBicG1uRWxlbWVudD0icHJvY2VzcyIgaWQ9IkJQTU5QbGFuZV84M2E1OTllMi0zMWVkLTRmOWMtODIxZi0zYzZjYTVkMTU4OTMiPgogICAgICA8YnBtbmRpOkJQTU5TaGFwZSBicG1uRWxlbWVudD0ic3RhcnRFdmVudF8yOGRjMmIwMy1iNWNjLTQ5M2ItYjg4Yi05NTdmMjQwNDYzMDMiIGlkPSJCUE1OU2hhcGVfZjk4OWJlMzgtYjVhZS00NDY4LWFmZWUtMWFlNzgzYTg5MTg1Ij4KICAgICAgICA8ZGM6Qm91bmRzIGhlaWdodD0iMzYuMCIgd2lkdGg9IjM2LjAiIHg9IjEwMC4wIiB5PSIxMDAuMCIvPgogICAgICA8L2JwbW5kaTpCUE1OU2hhcGU+CiAgICAgIDxicG1uZGk6QlBNTlNoYXBlIGJwbW5FbGVtZW50PSJ0YXNrIiBpZD0iQlBNTlNoYXBlX2RhYzgwMDQ4LTcwOTUtNDlhNC05MjQzLWJlNjYyZTMxN2UyNiI+CiAgICAgICAgPGRjOkJvdW5kcyBoZWlnaHQ9IjgwLjAiIHdpZHRoPSIxMDAuMCIgeD0iMTg2LjAiIHk9Ijc4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTlNoYXBlPgogICAgICA8YnBtbmRpOkJQTU5FZGdlIGJwbW5FbGVtZW50PSJzZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0IiBpZD0iQlBNTkVkZ2VfMWJlYWZmODItMWRiYy00ZDcwLWE1MzctZjgzZTk4NDU1NTU5Ij4KICAgICAgICA8ZGk6d2F5cG9pbnQgeD0iMTM2LjAiIHk9IjExOC4wIi8+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjE4Ni4wIiB5PSIxMTguMCIvPgogICAgICA8L2JwbW5kaTpCUE1ORWRnZT4KICAgICAgPGJwbW5kaTpCUE1OU2hhcGUgYnBtbkVsZW1lbnQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSIgaWQ9IkJQTU5TaGFwZV84MDJiNzM0ZC0xZjEzLTRjNDUtODg3My03MGVhMDgzYzIxNTYiPgogICAgICAgIDxkYzpCb3VuZHMgaGVpZ2h0PSIzNi4wIiB3aWR0aD0iMzYuMCIgeD0iMzM2LjAiIHk9IjEwMC4wIi8+CiAgICAgIDwvYnBtbmRpOkJQTU5TaGFwZT4KICAgICAgPGJwbW5kaTpCUE1ORWRnZSBicG1uRWxlbWVudD0ic2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZCIgaWQ9IkJQTU5FZGdlX2U4ZDMzOWI5LWRkOTEtNGJlMS1hMzk5LTUyNTIwZWZhZWRjMiI+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjI4Ni4wIiB5PSIxMTguMCIvPgogICAgICAgIDxkaTp3YXlwb2ludCB4PSIzMzYuMCIgeT0iMTE4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTkVkZ2U+CiAgICA8L2JwbW5kaTpCUE1OUGxhbmU+CiAgPC9icG1uZGk6QlBNTkRpYWdyYW0+CjwvZGVmaW5pdGlvbnM+Cg==","resourceName":"process.bpmn"}],"processesMetadata":[]},"key":-1,"sourceRecordPosition":-1,"position":1,"valueType":"DEPLOYMENT","timestamp":1622047862394,"recordType":"COMMAND","intent":"CREATE","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:06.689 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"resource":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiIHN0YW5kYWxvbmU9Im5vIj8+CjxkZWZpbml0aW9ucyB4bWxuczpicG1uZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvREkiIHhtbG5zOmRjPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9ERC8yMDEwMDUyNC9EQyIgeG1sbnM6ZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0RELzIwMTAwNTI0L0RJIiB4bWxuczpuczA9Imh0dHA6Ly9jYW11bmRhLm9yZy9zY2hlbWEvemVlYmUvMS4wIiBpZD0iZGVmaW5pdGlvbnNfYTc2N2M0ZGYtNDVjNy00ZWY2LTgxZWQtZGUxNzhjYTRhODNjIiB0YXJnZXROYW1lc3BhY2U9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvTU9ERUwiIHhtbG5zPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9CUE1OLzIwMTAwNTI0L01PREVMIj4KICA8cHJvY2VzcyBpZD0icHJvY2VzcyIgaXNFeGVjdXRhYmxlPSJ0cnVlIj4KICAgIDxzdGFydEV2ZW50IGlkPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyI+CiAgICAgIDxvdXRnb2luZz5zZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0PC9vdXRnb2luZz4KICAgIDwvc3RhcnRFdmVudD4KICAgIDxzZXJ2aWNlVGFzayBpZD0idGFzayIgbmFtZT0idGFzayI+CiAgICAgIDxleHRlbnNpb25FbGVtZW50cz4KICAgICAgICA8bnMwOnRhc2tEZWZpbml0aW9uIHR5cGU9InRhc2siLz4KICAgICAgPC9leHRlbnNpb25FbGVtZW50cz4KICAgICAgPGluY29taW5nPnNlcXVlbmNlRmxvd19kM2YxMWUxZC04N2E0LTRjMDctOGI5NC1hYmUxMmQ5OGM1MjQ8L2luY29taW5nPgogICAgICA8b3V0Z29pbmc+c2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZDwvb3V0Z29pbmc+CiAgICA8L3NlcnZpY2VUYXNrPgogICAgPHNlcXVlbmNlRmxvdyBpZD0ic2VxdWVuY2VGbG93X2QzZjExZTFkLTg3YTQtNGMwNy04Yjk0LWFiZTEyZDk4YzUyNCIgc291cmNlUmVmPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyIgdGFyZ2V0UmVmPSJ0YXNrIi8+CiAgICA8ZW5kRXZlbnQgaWQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSI+CiAgICAgIDxpbmNvbWluZz5zZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkPC9pbmNvbWluZz4KICAgIDwvZW5kRXZlbnQ+CiAgICA8c2VxdWVuY2VGbG93IGlkPSJzZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkIiBzb3VyY2VSZWY9InRhc2siIHRhcmdldFJlZj0iZW5kRXZlbnRfYzU4YzA0YTYtZTU0Mi00OWM0LTg5NzMtODU4NzNjZWVmM2Y1Ii8+CiAgPC9wcm9jZXNzPgogIDxicG1uZGk6QlBNTkRpYWdyYW0gaWQ9IkJQTU5EaWFncmFtXzM5ZTQxNzVlLTQxNDMtNGU5MC04ZjQxLWY2NGVhMGU4ZDUyOSI+CiAgICA8YnBtbmRpOkJQTU5QbGFuZSBicG1uRWxlbWVudD0icHJvY2VzcyIgaWQ9IkJQTU5QbGFuZV84M2E1OTllMi0zMWVkLTRmOWMtODIxZi0zYzZjYTVkMTU4OTMiPgogICAgICA8YnBtbmRpOkJQTU5TaGFwZSBicG1uRWxlbWVudD0ic3RhcnRFdmVudF8yOGRjMmIwMy1iNWNjLTQ5M2ItYjg4Yi05NTdmMjQwNDYzMDMiIGlkPSJCUE1OU2hhcGVfZjk4OWJlMzgtYjVhZS00NDY4LWFmZWUtMWFlNzgzYTg5MTg1Ij4KICAgICAgICA8ZGM6Qm91bmRzIGhlaWdodD0iMzYuMCIgd2lkdGg9IjM2LjAiIHg9IjEwMC4wIiB5PSIxMDAuMCIvPgogICAgICA8L2JwbW5kaTpCUE1OU2hhcGU+CiAgICAgIDxicG1uZGk6QlBNTlNoYXBlIGJwbW5FbGVtZW50PSJ0YXNrIiBpZD0iQlBNTlNoYXBlX2RhYzgwMDQ4LTcwOTUtNDlhNC05MjQzLWJlNjYyZTMxN2UyNiI+CiAgICAgICAgPGRjOkJvdW5kcyBoZWlnaHQ9IjgwLjAiIHdpZHRoPSIxMDAuMCIgeD0iMTg2LjAiIHk9Ijc4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTlNoYXBlPgogICAgICA8YnBtbmRpOkJQTU5FZGdlIGJwbW5FbGVtZW50PSJzZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0IiBpZD0iQlBNTkVkZ2VfMWJlYWZmODItMWRiYy00ZDcwLWE1MzctZjgzZTk4NDU1NTU5Ij4KICAgICAgICA8ZGk6d2F5cG9pbnQgeD0iMTM2LjAiIHk9IjExOC4wIi8+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjE4Ni4wIiB5PSIxMTguMCIvPgogICAgICA8L2JwbW5kaTpCUE1ORWRnZT4KICAgICAgPGJwbW5kaTpCUE1OU2hhcGUgYnBtbkVsZW1lbnQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSIgaWQ9IkJQTU5TaGFwZV84MDJiNzM0ZC0xZjEzLTRjNDUtODg3My03MGVhMDgzYzIxNTYiPgogICAgICAgIDxkYzpCb3VuZHMgaGVpZ2h0PSIzNi4wIiB3aWR0aD0iMzYuMCIgeD0iMzM2LjAiIHk9IjEwMC4wIi8+CiAgICAgIDwvYnBtbmRpOkJQTU5TaGFwZT4KICAgICAgPGJwbW5kaTpCUE1ORWRnZSBicG1uRWxlbWVudD0ic2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZCIgaWQ9IkJQTU5FZGdlX2U4ZDMzOWI5LWRkOTEtNGJlMS1hMzk5LTUyNTIwZWZhZWRjMiI+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjI4Ni4wIiB5PSIxMTguMCIvPgogICAgICAgIDxkaTp3YXlwb2ludCB4PSIzMzYuMCIgeT0iMTE4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTkVkZ2U+CiAgICA8L2JwbW5kaTpCUE1OUGxhbmU+CiAgPC9icG1uZGk6QlBNTkRpYWdyYW0+CjwvZGVmaW5pdGlvbnM+Cg==","version":1,"resourceName":"process.bpmn","bpmnProcessId":"process","processDefinitionKey":2251799813685249,"checksum":"+hkdxhEaP0ttdkhKS+R6RQ=="},"key":2251799813685249,"sourceRecordPosition":1,"position":2,"valueType":"PROCESS","timestamp":1622047863254,"recordType":"EVENT","intent":"CREATED","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:07.055 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"resources":[{"resource":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiIHN0YW5kYWxvbmU9Im5vIj8+CjxkZWZpbml0aW9ucyB4bWxuczpicG1uZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvREkiIHhtbG5zOmRjPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9ERC8yMDEwMDUyNC9EQyIgeG1sbnM6ZGk9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0RELzIwMTAwNTI0L0RJIiB4bWxuczpuczA9Imh0dHA6Ly9jYW11bmRhLm9yZy9zY2hlbWEvemVlYmUvMS4wIiBpZD0iZGVmaW5pdGlvbnNfYTc2N2M0ZGYtNDVjNy00ZWY2LTgxZWQtZGUxNzhjYTRhODNjIiB0YXJnZXROYW1lc3BhY2U9Imh0dHA6Ly93d3cub21nLm9yZy9zcGVjL0JQTU4vMjAxMDA1MjQvTU9ERUwiIHhtbG5zPSJodHRwOi8vd3d3Lm9tZy5vcmcvc3BlYy9CUE1OLzIwMTAwNTI0L01PREVMIj4KICA8cHJvY2VzcyBpZD0icHJvY2VzcyIgaXNFeGVjdXRhYmxlPSJ0cnVlIj4KICAgIDxzdGFydEV2ZW50IGlkPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyI+CiAgICAgIDxvdXRnb2luZz5zZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0PC9vdXRnb2luZz4KICAgIDwvc3RhcnRFdmVudD4KICAgIDxzZXJ2aWNlVGFzayBpZD0idGFzayIgbmFtZT0idGFzayI+CiAgICAgIDxleHRlbnNpb25FbGVtZW50cz4KICAgICAgICA8bnMwOnRhc2tEZWZpbml0aW9uIHR5cGU9InRhc2siLz4KICAgICAgPC9leHRlbnNpb25FbGVtZW50cz4KICAgICAgPGluY29taW5nPnNlcXVlbmNlRmxvd19kM2YxMWUxZC04N2E0LTRjMDctOGI5NC1hYmUxMmQ5OGM1MjQ8L2luY29taW5nPgogICAgICA8b3V0Z29pbmc+c2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZDwvb3V0Z29pbmc+CiAgICA8L3NlcnZpY2VUYXNrPgogICAgPHNlcXVlbmNlRmxvdyBpZD0ic2VxdWVuY2VGbG93X2QzZjExZTFkLTg3YTQtNGMwNy04Yjk0LWFiZTEyZDk4YzUyNCIgc291cmNlUmVmPSJzdGFydEV2ZW50XzI4ZGMyYjAzLWI1Y2MtNDkzYi1iODhiLTk1N2YyNDA0NjMwMyIgdGFyZ2V0UmVmPSJ0YXNrIi8+CiAgICA8ZW5kRXZlbnQgaWQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSI+CiAgICAgIDxpbmNvbWluZz5zZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkPC9pbmNvbWluZz4KICAgIDwvZW5kRXZlbnQ+CiAgICA8c2VxdWVuY2VGbG93IGlkPSJzZXF1ZW5jZUZsb3dfYzhkYjgxMGMtZWYzZS00NzAyLWE0YTgtZGE0MjdkOGNiZGRkIiBzb3VyY2VSZWY9InRhc2siIHRhcmdldFJlZj0iZW5kRXZlbnRfYzU4YzA0YTYtZTU0Mi00OWM0LTg5NzMtODU4NzNjZWVmM2Y1Ii8+CiAgPC9wcm9jZXNzPgogIDxicG1uZGk6QlBNTkRpYWdyYW0gaWQ9IkJQTU5EaWFncmFtXzM5ZTQxNzVlLTQxNDMtNGU5MC04ZjQxLWY2NGVhMGU4ZDUyOSI+CiAgICA8YnBtbmRpOkJQTU5QbGFuZSBicG1uRWxlbWVudD0icHJvY2VzcyIgaWQ9IkJQTU5QbGFuZV84M2E1OTllMi0zMWVkLTRmOWMtODIxZi0zYzZjYTVkMTU4OTMiPgogICAgICA8YnBtbmRpOkJQTU5TaGFwZSBicG1uRWxlbWVudD0ic3RhcnRFdmVudF8yOGRjMmIwMy1iNWNjLTQ5M2ItYjg4Yi05NTdmMjQwNDYzMDMiIGlkPSJCUE1OU2hhcGVfZjk4OWJlMzgtYjVhZS00NDY4LWFmZWUtMWFlNzgzYTg5MTg1Ij4KICAgICAgICA8ZGM6Qm91bmRzIGhlaWdodD0iMzYuMCIgd2lkdGg9IjM2LjAiIHg9IjEwMC4wIiB5PSIxMDAuMCIvPgogICAgICA8L2JwbW5kaTpCUE1OU2hhcGU+CiAgICAgIDxicG1uZGk6QlBNTlNoYXBlIGJwbW5FbGVtZW50PSJ0YXNrIiBpZD0iQlBNTlNoYXBlX2RhYzgwMDQ4LTcwOTUtNDlhNC05MjQzLWJlNjYyZTMxN2UyNiI+CiAgICAgICAgPGRjOkJvdW5kcyBoZWlnaHQ9IjgwLjAiIHdpZHRoPSIxMDAuMCIgeD0iMTg2LjAiIHk9Ijc4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTlNoYXBlPgogICAgICA8YnBtbmRpOkJQTU5FZGdlIGJwbW5FbGVtZW50PSJzZXF1ZW5jZUZsb3dfZDNmMTFlMWQtODdhNC00YzA3LThiOTQtYWJlMTJkOThjNTI0IiBpZD0iQlBNTkVkZ2VfMWJlYWZmODItMWRiYy00ZDcwLWE1MzctZjgzZTk4NDU1NTU5Ij4KICAgICAgICA8ZGk6d2F5cG9pbnQgeD0iMTM2LjAiIHk9IjExOC4wIi8+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjE4Ni4wIiB5PSIxMTguMCIvPgogICAgICA8L2JwbW5kaTpCUE1ORWRnZT4KICAgICAgPGJwbW5kaTpCUE1OU2hhcGUgYnBtbkVsZW1lbnQ9ImVuZEV2ZW50X2M1OGMwNGE2LWU1NDItNDljNC04OTczLTg1ODczY2VlZjNmNSIgaWQ9IkJQTU5TaGFwZV84MDJiNzM0ZC0xZjEzLTRjNDUtODg3My03MGVhMDgzYzIxNTYiPgogICAgICAgIDxkYzpCb3VuZHMgaGVpZ2h0PSIzNi4wIiB3aWR0aD0iMzYuMCIgeD0iMzM2LjAiIHk9IjEwMC4wIi8+CiAgICAgIDwvYnBtbmRpOkJQTU5TaGFwZT4KICAgICAgPGJwbW5kaTpCUE1ORWRnZSBicG1uRWxlbWVudD0ic2VxdWVuY2VGbG93X2M4ZGI4MTBjLWVmM2UtNDcwMi1hNGE4LWRhNDI3ZDhjYmRkZCIgaWQ9IkJQTU5FZGdlX2U4ZDMzOWI5LWRkOTEtNGJlMS1hMzk5LTUyNTIwZWZhZWRjMiI+CiAgICAgICAgPGRpOndheXBvaW50IHg9IjI4Ni4wIiB5PSIxMTguMCIvPgogICAgICAgIDxkaTp3YXlwb2ludCB4PSIzMzYuMCIgeT0iMTE4LjAiLz4KICAgICAgPC9icG1uZGk6QlBNTkVkZ2U+CiAgICA8L2JwbW5kaTpCUE1OUGxhbmU+CiAgPC9icG1uZGk6QlBNTkRpYWdyYW0+CjwvZGVmaW5pdGlvbnM+Cg==","resourceName":"process.bpmn"}],"processesMetadata":[{"version":1,"resourceName":"process.bpmn","bpmnProcessId":"process","processDefinitionKey":2251799813685249,"checksum":"+hkdxhEaP0ttdkhKS+R6RQ=="}]},"key":2251799813685250,"sourceRecordPosition":1,"position":3,"valueType":"DEPLOYMENT","timestamp":1622047863254,"recordType":"EVENT","intent":"CREATED","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:07.057 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"resources":[],"processesMetadata":[]},"key":2251799813685250,"sourceRecordPosition":1,"position":4,"valueType":"DEPLOYMENT","timestamp":1622047863254,"recordType":"EVENT","intent":"FULLY_DISTRIBUTED","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:07.091 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":-1,"variables":{},"bpmnProcessId":"process","processDefinitionKey":0,"processInstanceKey":-1},"key":-1,"sourceRecordPosition":-1,"position":5,"valueType":"PROCESS_INSTANCE_CREATION","timestamp":1622047863808,"recordType":"COMMAND","intent":"CREATE","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:07.093 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":1,"bpmnProcessId":"process","processDefinitionKey":2251799813685249,"elementId":"process","flowScopeKey":-1,"bpmnElementType":"PROCESS","parentProcessInstanceKey":-1,"parentElementInstanceKey":-1,"processInstanceKey":2251799813685251},"key":2251799813685251,"sourceRecordPosition":5,"position":6,"valueType":"PROCESS_INSTANCE","timestamp":1622047866684,"recordType":"COMMAND","intent":"ACTIVATE_ELEMENT","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:07.094 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":1,"variables":{},"bpmnProcessId":"process","processDefinitionKey":2251799813685249,"processInstanceKey":2251799813685251},"key":2251799813685252,"sourceRecordPosition":5,"position":7,"valueType":"PROCESS_INSTANCE_CREATION","timestamp":1622047866684,"recordType":"EVENT","intent":"CREATED","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:09.786 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":1,"bpmnProcessId":"process","processDefinitionKey":2251799813685249,"elementId":"process","flowScopeKey":-1,"bpmnElementType":"PROCESS","parentProcessInstanceKey":-1,"parentElementInstanceKey":-1,"processInstanceKey":2251799813685251},"key":2251799813685251,"sourceRecordPosition":6,"position":8,"valueType":"PROCESS_INSTANCE","timestamp":1622047867053,"recordType":"EVENT","intent":"ELEMENT_ACTIVATING","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:09.787 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":1,"bpmnProcessId":"process","processDefinitionKey":2251799813685249,"elementId":"process","flowScopeKey":-1,"bpmnElementType":"PROCESS","parentProcessInstanceKey":-1,"parentElementInstanceKey":-1,"processInstanceKey":2251799813685251},"key":2251799813685251,"sourceRecordPosition":6,"position":9,"valueType":"PROCESS_INSTANCE","timestamp":1622047867053,"recordType":"EVENT","intent":"ELEMENT_ACTIVATED","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
2021-05-26 16:51:09.787 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG
      io.camunda.zeebe.broker.exporter.DebugLogExporter - {"partitionId":1,"value":{"version":1,"bpmnProcessId":"process","processDefinitionKey":2251799813685249,"elementId":"startEvent_28dc2b03-b5cc-493b-b88b-957f24046303","flowScopeKey":2251799813685251,"bpmnElementType":"START_EVENT","parentProcessInstanceKey":-1,"parentElementInstanceKey":-1,"processInstanceKey":2251799813685251},"key":-1,"sourceRecordPosition":6,"position":10,"valueType":"PROCESS_INSTANCE","timestamp":1622047867053,"recordType":"COMMAND","intent":"ACTIVATE_ELEMENT","rejectionType":"NULL_VAL","rejectionReason":"","brokerVersion":"1.1.0"}
16:51:12.303 [ForkJoinPool-1-worker-3] [] ERROR io.camunda.zeebe.test.ContainerState - 
===============================================
Gateway logs
===============================================
++ hostname -i
+ HOST=172.19.0.3
+ '[' true = true ']'
+ export ZEEBE_GATEWAY_NETWORK_HOST=0.0.0.0
+ ZEEBE_GATEWAY_NETWORK_HOST=0.0.0.0
+ export ZEEBE_GATEWAY_CLUSTER_HOST=tc-8VMoDqBu
+ ZEEBE_GATEWAY_CLUSTER_HOST=tc-8VMoDqBu
+ exec /usr/local/zeebe/bin/gateway
  ______  ______   ______   ____    ______      _____              _______   ______  __          __            __     __
 |___  / |  ____| |  ____| |  _ \  |  ____|    / ____|     /\     |__   __| |  ____| \ \        / /     /\     \ \   / /
    / /  | |__    | |__    | |_) | | |__      | |  __     /  \       | |    | |__     \ \  /\  / /     /  \     \ \_/ /
   / /   |  __|   |  __|   |  _ <  |  __|     | | |_ |   / /\ \      | |    |  __|     \ \/  \/ /     / /\ \     \   /
  / /__  | |____  | |____  | |_) | | |____    | |__| |  / ____ \     | |    | |____     \  /\  /     / ____ \     | |
 /_____| |______| |______| |____/  |______|    \_____| /_/    \_\    |_|    |______|     \/  \/     /_/    \_\    |_|

2021-05-26 16:50:54.412 [] [main] INFO 
      io.camunda.zeebe.gateway.StandaloneGateway - Starting StandaloneGateway v1.0.0 using Java 11.0.11 on 2a92d86e33de with PID 8 (/usr/local/zeebe/lib/camunda-cloud-zeebe-1.0.0.jar started by root in /usr/local/zeebe)
2021-05-26 16:50:54.535 [] [main] DEBUG
      io.camunda.zeebe.gateway.StandaloneGateway - Running with Spring Boot v2.4.5, Spring v5.3.6
2021-05-26 16:50:54.536 [] [main] INFO 
      io.camunda.zeebe.gateway.StandaloneGateway - No active profile set, falling back to default profiles: default
2021-05-26 16:50:55.976 [] [main] INFO 
      org.springframework.boot.web.embedded.tomcat.TomcatWebServer - Tomcat initialized with port(s): 9600 (http)
2021-05-26 16:50:55.988 [] [main] INFO 
      org.apache.coyote.http11.Http11NioProtocol - Initializing ProtocolHandler ["http-nio-0.0.0.0-9600"]
2021-05-26 16:50:55.989 [] [main] INFO 
      org.apache.catalina.core.StandardService - Starting service [Tomcat]
2021-05-26 16:50:55.990 [] [main] INFO 
      org.apache.catalina.core.StandardEngine - Starting Servlet engine: [Apache Tomcat/9.0.45]
2021-05-26 16:50:56.117 [] [main] INFO 
      org.apache.catalina.core.ContainerBase.[Tomcat].[localhost].[/] - Initializing Spring embedded WebApplicationContext
2021-05-26 16:50:56.117 [] [main] INFO 
      org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext - Root WebApplicationContext: initialization completed in 1527 ms
2021-05-26 16:50:56.585 [] [main] INFO 
      org.springframework.scheduling.concurrent.ThreadPoolTaskExecutor - Initializing ExecutorService 'applicationTaskExecutor'
2021-05-26 16:50:56.925 [] [main] INFO 
      org.springframework.scheduling.concurrent.ThreadPoolTaskScheduler - Initializing ExecutorService 'taskScheduler'
2021-05-26 16:50:57.075 [] [main] INFO 
      org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 3 endpoint(s) beneath base path '/actuator'
2021-05-26 16:50:57.108 [] [main] INFO 
      org.apache.coyote.http11.Http11NioProtocol - Starting ProtocolHandler ["http-nio-0.0.0.0-9600"]
2021-05-26 16:50:57.129 [] [main] INFO 
      org.springframework.boot.web.embedded.tomcat.TomcatWebServer - Tomcat started on port(s): 9600 (http) with context path ''
2021-05-26 16:50:57.150 [] [main] INFO 
      io.camunda.zeebe.gateway.StandaloneGateway - Started StandaloneGateway in 3.24 seconds (JVM running for 5.282)
2021-05-26 16:50:57.164 [] [main] INFO 
      io.camunda.zeebe.gateway - Version: 1.0.0
2021-05-26 16:50:57.180 [] [main] INFO 
      io.camunda.zeebe.gateway - Starting standalone gateway with configuration {
  "network" : {
    "host" : "0.0.0.0",
    "port" : 26500,
    "minKeepAliveInterval" : "PT30S"
  },
  "cluster" : {
    "contactPoint" : "tc-w4Er4nPM:26502",
    "requestTimeout" : "PT15S",
    "clusterName" : "zeebe-cluster",
    "memberId" : "tc-8VMoDqBu",
    "host" : "tc-8VMoDqBu",
    "port" : 26502,
    "membership" : {
      "broadcastUpdates" : false,
      "broadcastDisputes" : true,
      "notifySuspect" : false,
      "gossipInterval" : "PT0.25S",
      "gossipFanout" : 2,
      "probeInterval" : "PT1S",
      "probeTimeout" : "PT0.1S",
      "suspectProbes" : 3,
      "failureTimeout" : "PT10S",
      "syncInterval" : "PT10S"
    }
  },
  "threads" : {
    "managementThreads" : 1
  },
  "monitoring" : {
    "enabled" : false,
    "host" : "0.0.0.0",
    "port" : 9600
  },
  "security" : {
    "enabled" : false,
    "certificateChainPath" : null,
    "privateKeyPath" : null
  },
  "longPolling" : {
    "enabled" : true
  },
  "initialized" : true
}
2021-05-26 16:50:57.760 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on tc-8VMoDqBu:26502
2021-05-26 16:50:57.767 [] [netty-messaging-event-epoll-server-0] INFO 
      io.atomix.cluster.messaging.impl.NettyMessagingService - Started
2021-05-26 16:50:57.790 [] [main] INFO 
      io.camunda.zeebe.gateway - Version: 1.0.0
2021-05-26 16:50:57.791 [] [main] INFO 
      io.camunda.zeebe.gateway - Starting gateway with configuration {
  "network" : {
    "host" : "0.0.0.0",
    "port" : 26500,
    "minKeepAliveInterval" : "PT30S"
  },
  "cluster" : {
    "contactPoint" : "tc-w4Er4nPM:26502",
    "requestTimeout" : "PT15S",
    "clusterName" : "zeebe-cluster",
    "memberId" : "tc-8VMoDqBu",
    "host" : "tc-8VMoDqBu",
    "port" : 26502,
    "membership" : {
      "broadcastUpdates" : false,
      "broadcastDisputes" : true,
      "notifySuspect" : false,
      "gossipInterval" : "PT0.25S",
      "gossipFanout" : 2,
      "probeInterval" : "PT1S",
      "probeTimeout" : "PT0.1S",
      "suspectProbes" : 3,
      "failureTimeout" : "PT10S",
      "syncInterval" : "PT10S"
    }
  },
  "threads" : {
    "managementThreads" : 1
  },
  "monitoring" : {
    "enabled" : false,
    "host" : "0.0.0.0",
    "port" : 9600
  },
  "security" : {
    "enabled" : false,
    "certificateChainPath" : null,
    "privateKeyPath" : null
  },
  "longPolling" : {
    "enabled" : true
  },
  "initialized" : true
}
2021-05-26 16:50:57.800 [] [netty-unicast-event-nio-client-0] INFO 
      io.atomix.cluster.messaging.impl.NettyUnicastService - UDP server listening for connections on 0.0.0.0:26502
2021-05-26 16:50:57.801 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.discovery.BootstrapDiscoveryProvider - Joined
2021-05-26 16:50:57.806 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.protocol.SwimMembershipProtocol - Started
2021-05-26 16:50:57.807 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.impl.DefaultClusterMembershipService - Started
2021-05-26 16:50:57.807 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.messaging.impl.DefaultClusterCommunicationService - Started
2021-05-26 16:50:57.809 [] [atomix-cluster-0] INFO 
      io.atomix.cluster.messaging.impl.DefaultClusterEventService - Started
2021-05-26 16:50:58.927 [GatewayTopologyManager] [gateway-scheduler-zb-actors-0] DEBUG
      io.camunda.zeebe.gateway - Received new broker BrokerInfo{nodeId=0, partitionsCount=1, clusterSize=1, replicationFactor=1, partitionRoles={1=LEADER}, partitionLeaderTerms={1=1}, partitionHealthStatuses={1=HEALTHY}, version=1.1.0-SNAPSHOT}.
npepinpe commented 3 years ago

We can now track flakiness of tests individually via the build result dashboard. I'm closing these issues and we can reopen as we see them occur.

nicpuppa commented 6 months ago

Happened again here

Test results for [IT] QA Update Tests.zip

npepinpe commented 4 months ago

Is this still an ongoing issue? Do we have more recent logs?

npepinpe commented 4 months ago

Closing, please provide logs if you reopen so we can tackle this with some info.