search

hazelcast / hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
https://www.hazelcast.com
Other
6.08k stars 1.83k forks source link

com.hazelcast.jet.core.OperationLossTest.when_terminateExecutionOperationLost_then_jobTerminates #23154

Closed sumnerib closed 1 month ago

sumnerib commented 1 year ago

5.2.z (commit 1220031d020bd0effd4059af9ae712c284df1cef)

Failed on IbmJDK8-nightly: https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-IbmJDK8-nightly/62/testReport/junit/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

Stacktrace: ``` java.lang.AssertionError: jobId=0913-8109-7200-0001 expected: but was: at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.failNotEquals(Assert.java:835) at org.junit.Assert.assertEquals(Assert.java:120) at com.hazelcast.jet.core.JetTestSupport.lambda$assertJobStatusEventually$2(JetTestSupport.java:306) at com.hazelcast.test.HazelcastTestSupport.assertTrueEventually(HazelcastTestSupport.java:1247) at com.hazelcast.test.HazelcastTestSupport.assertTrueEventually(HazelcastTestSupport.java:1264) at com.hazelcast.jet.core.JetTestSupport.assertJobStatusEventually(JetTestSupport.java:305) at com.hazelcast.jet.core.JetTestSupport.assertJobStatusEventually(JetTestSupport.java:235) at com.hazelcast.jet.core.OperationLossTest.when_terminateExecutionOperationLost_then_jobTerminates(OperationLossTest.java:205) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:115) at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:107) at java.util.concurrent.FutureTask.run(FutureTask.java:277) at java.lang.Thread.run(Thread.java:825) ```
Standard output: ``` 17:15:17,325 INFO || - [PartitionStateManager] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Initializing cluster partition table arrangement... 17:15:17,329 DEBUG || - [JobClassLoaderService] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Creating job classLoader for job 0913-8109-7200-0001 17:15:17,329 DEBUG || - [JobClassLoaderService] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Create processor classloader map for job 0913-8109-7200-0001 17:15:17,352 INFO || - [JobCoordinationService] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Starting job 0913-8109-7200-0001 based on submit request 17:15:17,362 INFO || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Didn't find any snapshot to restore for job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:17,362 INFO || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Start executing job '0913-8109-7200-0001', execution 0913-8109-7201-0001, execution graph in DOT format: digraph DAG { "v1" [localParallelism=1]; "v2" [localParallelism=1]; "v1" -> "v2" [label="distributed", queueSize=1024]; } HINT: You can use graphviz or http://viz-js.com to visualize the printed graph. 17:15:17,362 DEBUG || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Building execution plan for job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:17,369 DEBUG || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Built execution plans for job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:17,372 DEBUG || - [InitExecutionOperation] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Initializing execution plan for job 0913-8109-7200-0001, execution 0913-8109-7201-0001 from [127.0.0.1]:5701 17:15:17,720 INFO || - [JobExecutionService] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Execution plan for jobId=0913-8109-7200-0001, jobName='0913-8109-7200-0001', executionId=0913-8109-7201-0001 initialized 17:15:21,546 WARN || - [Invocation] hz.elegant_shockley.response-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Future.complete(Object) on completed future. Request: Invocation{op=com.hazelcast.internal.partition.operation.PartitionBackupReplicaAntiEntropyOperation{serviceName='hz:core:partitionService', identityHash=1237958435, partitionId=4, replicaIndex=1, callId=24, invocationTime=1670692517399 (2022-12-10 17:15:17.399), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0, versions={}}, tryCount=10, tryPauseMillis=250, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517399, firstInvocationTime='2022-12-10 17:15:17.399', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@5bf9ce92}, current value: Invocation::HEARTBEAT_TIMEOUT, offered value: Invocation::CALL_TIMEOUT java.lang.Exception: Future.complete(Object) on completed future. Request: Invocation{op=com.hazelcast.internal.partition.operation.PartitionBackupReplicaAntiEntropyOperation{serviceName='hz:core:partitionService', identityHash=1237958435, partitionId=4, replicaIndex=1, callId=24, invocationTime=1670692517399 (2022-12-10 17:15:17.399), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0, versions={}}, tryCount=10, tryPauseMillis=250, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517399, firstInvocationTime='2022-12-10 17:15:17.399', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@5bf9ce92}, current value: Invocation::HEARTBEAT_TIMEOUT, offered value: Invocation::CALL_TIMEOUT at com.hazelcast.spi.impl.AbstractInvocationFuture.warnIfSuspiciousDoubleCompletion(AbstractInvocationFuture.java:1256) ~[classes/:?] at com.hazelcast.spi.impl.AbstractInvocationFuture.complete0(AbstractInvocationFuture.java:1230) ~[classes/:?] at com.hazelcast.spi.impl.AbstractInvocationFuture.complete(AbstractInvocationFuture.java:1219) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.Invocation.complete(Invocation.java:673) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.Invocation.notifyCallTimeout(Invocation.java:395) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InboundResponseHandler.notifyCallTimeout(InboundResponseHandler.java:173) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InboundResponseHandler.accept(InboundResponseHandler.java:97) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InboundResponseHandlerSupplier$ResponseThread.doRun(InboundResponseHandlerSupplier.java:297) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InboundResponseHandlerSupplier$ResponseThread.executeRun(InboundResponseHandlerSupplier.java:284) ~[classes/:?] at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[classes/:?] 17:15:21,549 WARN || - [Invocation] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Future.complete(Object) on completed future. Request: Invocation{op=com.hazelcast.internal.partition.operation.PartitionBackupReplicaAntiEntropyOperation{serviceName='hz:core:partitionService', identityHash=459909262, partitionId=1, replicaIndex=1, callId=25, invocationTime=1670692517399 (2022-12-10 17:15:17.399), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0, versions={}}, tryCount=10, tryPauseMillis=250, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517399, firstInvocationTime='2022-12-10 17:15:17.399', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@4f99516e}, current value: Invocation::CALL_TIMEOUT, offered value: Invocation::HEARTBEAT_TIMEOUT java.lang.Exception: Future.complete(Object) on completed future. Request: Invocation{op=com.hazelcast.internal.partition.operation.PartitionBackupReplicaAntiEntropyOperation{serviceName='hz:core:partitionService', identityHash=459909262, partitionId=1, replicaIndex=1, callId=25, invocationTime=1670692517399 (2022-12-10 17:15:17.399), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0, versions={}}, tryCount=10, tryPauseMillis=250, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517399, firstInvocationTime='2022-12-10 17:15:17.399', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@4f99516e}, current value: Invocation::CALL_TIMEOUT, offered value: Invocation::HEARTBEAT_TIMEOUT at com.hazelcast.spi.impl.AbstractInvocationFuture.warnIfSuspiciousDoubleCompletion(AbstractInvocationFuture.java:1256) ~[classes/:?] at com.hazelcast.spi.impl.AbstractInvocationFuture.complete0(AbstractInvocationFuture.java:1230) ~[classes/:?] at com.hazelcast.spi.impl.AbstractInvocationFuture.complete(AbstractInvocationFuture.java:1219) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.Invocation.complete(Invocation.java:673) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.Invocation.detectAndHandleTimeout(Invocation.java:445) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$MonitorInvocationsTask.run0(InvocationMonitor.java:325) ~[classes/:?] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$FixedRateMonitorTask.run(InvocationMonitor.java:282) ~[classes/:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522) ~[?:1.8.0] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:319) ~[?:1.8.0] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:191) ~[?:1.8.0] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:1.8.0] at java.lang.Thread.run(Thread.java:825) ~[?:2.9 (08-17-2022)] 17:15:21,550 DEBUG || - [JobCoordinationService] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Not starting jobs because partition replication is not in safe state, but in REPLICA_NOT_SYNC 17:15:21,550 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:4 timeouts:2 backup-timeouts:0 17:15:21,554 DEBUG || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Init of job '0913-8109-7200-0001', execution 0913-8109-7201-0001 has failures: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] 17:15:21,555 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 1ms 17:15:21,558 DEBUG || - [JobExecutionService] hz.elegant_shockley.async.thread-4 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] job '0913-8109-7200-0001', execution 0913-8109-7201-0001 calling completeExecution because execution terminated before it started 17:15:21,562 DEBUG || - [JobExecutionService] hz.elegant_shockley.async.thread-4 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Completed execution of job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:26,200 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:26,202 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:26,553 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:15:27,213 DEBUG || - [MasterJobContext] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Not scaling up job '0913-8109-7200-0001', execution 0913-8109-7201-0001: not running or already running on all members 17:15:31,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:31,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:31,554 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-8 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:15:36,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:36,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:36,573 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 6ms 17:15:41,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:41,197 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:41,555 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-9 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:15:46,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:46,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:46,554 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-8 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:15:51,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:51,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:51,568 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 4ms 17:15:56,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:15:56,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:15:56,555 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-9 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:01,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:01,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:01,554 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-8 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:06,200 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:06,201 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:06,556 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:11,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:11,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:11,555 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-4 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:16,200 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:16,202 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:16,566 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-5 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 3ms 17:16:21,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:21,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:21,556 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-7 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:26,197 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:26,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:26,577 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 8ms 17:16:31,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:31,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:31,555 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-3 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:36,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:36,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:36,556 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-8 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:41,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:41,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:41,557 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-11 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:46,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:46,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:46,556 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-13 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:51,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:51,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:51,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-7 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:16:56,199 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:16:56,199 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:16:56,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-10 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:01,199 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:17:01,200 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:17:01,557 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:06,200 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:17:06,200 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:17:06,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-1 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:11,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:17:11,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:17:11,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-7 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:16,198 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:2 timeouts:1 backup-timeouts:0 17:17:16,198 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-6 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:17:16,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-5 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:17,589 INFO |when_terminateExecutionOperationLost_then_jobTerminates| - [SimpleTestInClusterSupport] Time-limited test - Ditching 1 jobs in SimpleTestInClusterSupport.@After: [0913-8109-7200-0001] 17:17:17,590 DEBUG |when_terminateExecutionOperationLost_then_jobTerminates| - [AbstractJobProxy] Time-limited test - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Sending CANCEL_FORCEFUL request for job 0913-8109-7200-0001 (name ??) 17:17:21,199 INFO || - [InvocationMonitor] hz.elegant_shockley.InvocationMonitorThread - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Invocations:3 timeouts:1 backup-timeouts:0 17:17:21,199 WARN || - [MasterContext] ForkJoinPool.commonPool-worker-0 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Retrying com.hazelcast.jet.impl.operation.TerminateExecutionOperation that failed with OperationTimeoutException in job '0913-8109-7200-0001', execution 0913-8109-7201-0001 17:17:21,217 DEBUG || - [JobClassLoaderService] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Finish JobClassLoaders phaseCount = 0, removing classloaders for jobId=0913-8109-7200-0001 17:17:21,219 ERROR || - [MasterJobContext] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Execution of job '0913-8109-7200-0001', execution 0913-8109-7201-0001 failed Start time: 2022-12-10T17:15:17.354 Duration: 00:02:03.864 To see additional job metrics enable JobConfig.storeMetricsAfterJobCompletion com.hazelcast.jet.core.TopologyChangedException: Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] at com.hazelcast.jet.impl.MasterJobContext.getErrorFromResponses(MasterJobContext.java:591) ~[classes/:?] at com.hazelcast.jet.impl.MasterJobContext.lambda$onInitStepCompleted$7(MasterJobContext.java:470) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$54(JobCoordinationService.java:1306) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$55(JobCoordinationService.java:1327) ~[classes/:?] at com.hazelcast.internal.util.executor.CompletableFutureTask.run(CompletableFutureTask.java:64) ~[classes/:?] at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217) ~[classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:1.8.0] at java.lang.Thread.run(Thread.java:825) ~[?:2.9 (08-17-2022)] at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) ~[classes/:?] at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[classes/:?] 17:17:21,224 DEBUG || - [JobCoordinationService] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] job '0913-8109-7200-0001', execution 0913-8109-7201-0001 is completed 17:17:21,225 ERROR || - [JoinSubmittedJobOperation] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] com.hazelcast.jet.core.TopologyChangedException: Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] at com.hazelcast.jet.impl.MasterJobContext.getErrorFromResponses(MasterJobContext.java:591) ~[classes/:?] at com.hazelcast.jet.impl.MasterJobContext.lambda$onInitStepCompleted$7(MasterJobContext.java:470) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$54(JobCoordinationService.java:1306) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$55(JobCoordinationService.java:1327) ~[classes/:?] at com.hazelcast.internal.util.executor.CompletableFutureTask.run(CompletableFutureTask.java:64) ~[classes/:?] at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217) ~[classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:1.8.0] at java.lang.Thread.run(Thread.java:825) ~[?:2.9 (08-17-2022)] at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) ~[classes/:?] at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[classes/:?] 17:17:21,225 ERROR || - [JoinSubmittedJobOperation] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] com.hazelcast.jet.core.TopologyChangedException: Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] at com.hazelcast.jet.impl.MasterJobContext.getErrorFromResponses(MasterJobContext.java:591) ~[classes/:?] at com.hazelcast.jet.impl.MasterJobContext.lambda$onInitStepCompleted$7(MasterJobContext.java:470) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$54(JobCoordinationService.java:1306) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$55(JobCoordinationService.java:1327) ~[classes/:?] at com.hazelcast.internal.util.executor.CompletableFutureTask.run(CompletableFutureTask.java:64) ~[classes/:?] at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217) ~[classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:1.8.0] at java.lang.Thread.run(Thread.java:825) ~[?:2.9 (08-17-2022)] at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) ~[classes/:?] at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[classes/:?] 17:17:21,558 DEBUG || - [JobRepository] hz.elegant_shockley.cached.thread-2 - [127.0.0.1]:5701 [dev] [5.2.2-SNAPSHOT] Job cleanup took 0ms 17:17:21,726 WARN |when_terminateExecutionOperationLost_then_jobTerminates| - [JetTestSupport] Time-limited test - Failed to cancel the job and it is STARTING, retrying. Failure: com.hazelcast.jet.core.TopologyChangedException: Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] com.hazelcast.jet.core.TopologyChangedException: Causes from members: [[127.0.0.1]:5702=com.hazelcast.core.OperationTimeoutException: InitExecutionOperation got rejected before execution due to not starting within the operation-call-timeout of: 2000 ms. Current time: 2022-12-10 17:15:21.548. Start time: 2022-12-10 17:15:17.731. Total elapsed time: 3817 ms. Invocation{op=com.hazelcast.jet.impl.operation.InitExecutionOperation{serviceName='hz:impl:jetService', identityHash=-1996036714, partitionId=-1, replicaIndex=0, callId=31, invocationTime=1670692517731 (2022-12-10 17:15:17.731), waitTimeout=-1, callTimeout=2000, tenantControl=com.hazelcast.spi.impl.tenantcontrol.NoopTenantControl@0}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=2000, firstInvocationTimeMs=1670692517731, firstInvocationTime='2022-12-10 17:15:17.731', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 00:00:00.000', target=[127.0.0.1]:5702, pendingResponse={VOID}, backupsAcksExpected=-1, backupsAcksReceived=0, connection=com.hazelcast.internal.server.FirewallingServer$FirewallingConnection@f920a1a1}] at com.hazelcast.jet.impl.MasterJobContext.getErrorFromResponses(MasterJobContext.java:591) ~[classes/:?] at com.hazelcast.jet.impl.MasterJobContext.lambda$onInitStepCompleted$7(MasterJobContext.java:470) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$54(JobCoordinationService.java:1306) ~[classes/:?] at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$55(JobCoordinationService.java:1327) ~[classes/:?] at com.hazelcast.internal.util.executor.CompletableFutureTask.run(CompletableFutureTask.java:64) ~[classes/:?] at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217) ~[classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) ~[?:1.8.0] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:1.8.0] at java.lang.Thread.run(Thread.java:825) ~[?:2.9 (08-17-2022)] at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) ~[classes/:?] at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[classes/:?] 17:17:21,736 INFO |when_terminateExecutionOperationLost_then_jobTerminates| - [SimpleTestInClusterSupport] Time-limited test - Destroying 4 distributed objects in SimpleTestInClusterSupport.@After: [hz:impl:mapService/__jet.executionRecords, hz:impl:mapService/__jet.results, hz:impl:mapService/__jet.records, hz:impl:flakeIdGeneratorService/__jet.ids] BuildInfo right after when_terminateExecutionOperationLost_then_jobTerminates(com.hazelcast.jet.core.OperationLossTest): BuildInfo{version='5.2.2-SNAPSHOT', build='20221210', buildNumber=20221210, revision=1220031, enterprise=false, serializationVersion=1} Hiccups measured while running test 'when_terminateExecutionOperationLost_then_jobTerminates(com.hazelcast.jet.core.OperationLossTest):' 17:15:15, accumulated pauses: 69 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:15:20, accumulated pauses: 67 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:15:25, accumulated pauses: 66 ms, max pause: 1 ms, pauses over 1000 ms: 0 17:15:30, accumulated pauses: 80 ms, max pause: 2 ms, pauses over 1000 ms: 0 17:15:35, accumulated pauses: 68 ms, max pause: 2 ms, pauses over 1000 ms: 0 17:15:40, accumulated pauses: 69 ms, max pause: 5 ms, pauses over 1000 ms: 0 17:15:45, accumulated pauses: 76 ms, max pause: 4 ms, pauses over 1000 ms: 0 17:15:50, accumulated pauses: 64 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:15:55, accumulated pauses: 66 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:00, accumulated pauses: 62 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:05, accumulated pauses: 75 ms, max pause: 12 ms, pauses over 1000 ms: 0 17:16:10, accumulated pauses: 99 ms, max pause: 16 ms, pauses over 1000 ms: 0 17:16:15, accumulated pauses: 71 ms, max pause: 1 ms, pauses over 1000 ms: 0 17:16:20, accumulated pauses: 73 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:25, accumulated pauses: 68 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:30, accumulated pauses: 66 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:35, accumulated pauses: 71 ms, max pause: 4 ms, pauses over 1000 ms: 0 17:16:40, accumulated pauses: 65 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:45, accumulated pauses: 67 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:16:50, accumulated pauses: 67 ms, max pause: 3 ms, pauses over 1000 ms: 0 17:16:55, accumulated pauses: 62 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:17:00, accumulated pauses: 70 ms, max pause: 4 ms, pauses over 1000 ms: 0 17:17:05, accumulated pauses: 66 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:17:10, accumulated pauses: 67 ms, max pause: 0 ms, pauses over 1000 ms: 0 17:17:15, accumulated pauses: 124 ms, max pause: 56 ms, pauses over 1000 ms: 0 17:17:20, accumulated pauses: 21 ms, max pause: 0 ms, pauses over 1000 ms: 0 No metrics recorded during the test ```
olukas commented 1 year ago

Failed again on 5.3.z with ibm-8: https://jenkins.hazelcast.com/view/Official%20Builds/job/Hazelcast-5.maintenance-IbmJDK8-nightly/86/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

Patras3 commented 1 month ago

This comment was automatically generated to summarize test results for the last 90 days.


For branch: master
Builds between : 2024-05-15 21:50 - 2024-07-31 03:15
Jobs: 9, Runs: 39, Passed: 39, Failed: 0, Skipped: 0, Fail Ratio: 0.00%
Run on:
+--------------------------------------------------+
| JDK        | PASSED | FAILED | SKIPPED |  RATIO  |
+--------------------------------------------------+
| oracle-17  |   5    |   0    |    0    |   0.00% |
| unknown    |   13   |   0    |    0    |   0.00% |
| zing-21    |   3    |   0    |    0    |   0.00% |
| openj9-21  |   4    |   0    |    0    |   0.00% |
| oracle-21  |   5    |   0    |    0    |   0.00% |
| zing-17    |   4    |   0    |    0    |   0.00% |
| openjdk-17 |   5    |   0    |    0    |   0.00% |
+--------------------------------------------------+

Builds Timeline:
2024-07-31 03:15 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OpenJDK17-nightly-Esxi7/99/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-31 03:08 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OracleJDK21-nightly/28/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-29 03:12 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-Openj9-21-nightly/29/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-28 18:11 - PASSED (zing-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK21-nightly/32/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-28 12:12 - PASSED (oracle-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-nightly-force-offload/111/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-27 00:07 - PASSED (oracle-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-nightly-little-endian/89/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-26 18:06 - PASSED (zing-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK17-nightly/91/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-26 03:14 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZuluJDK17-nightly/128/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-24 21:52 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/26/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-24 03:15 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OpenJDK17-nightly-Esxi7/98/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-24 03:08 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OracleJDK21-nightly/27/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-22 03:12 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-Openj9-21-nightly/28/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-21 18:11 - PASSED (zing-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK21-nightly/31/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-20 00:07 - PASSED (oracle-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-nightly-little-endian/88/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-19 18:06 - PASSED (zing-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK17-nightly/90/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-19 03:14 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZuluJDK17-nightly/127/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-12 03:14 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZuluJDK17-nightly/126/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-10 21:52 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/24/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-10 09:10 - PASSED (zing-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK21-nightly/29/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-10 03:15 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OpenJDK17-nightly-Esxi7/96/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-10 03:08 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OracleJDK21-nightly/25/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-08 03:12 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-Openj9-21-nightly/26/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-06 00:07 - PASSED (oracle-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-nightly-little-endian/86/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-05 18:06 - PASSED (zing-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK17-nightly/88/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-05 03:14 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZuluJDK17-nightly/125/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-03 21:52 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/23/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-03 03:28 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OracleJDK21-nightly/24/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-03 03:15 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OpenJDK17-nightly-Esxi7/95/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-01 03:12 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-Openj9-21-nightly/25/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-29 00:07 - PASSED (oracle-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-nightly-little-endian/85/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-28 18:30 - PASSED (zing-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZingJDK17-nightly/87/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-28 03:14 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-master-ZuluJDK17-nightly/124/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-26 21:53 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/22/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-19 21:53 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/21/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-12 21:48 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/20/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-05 21:48 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/19/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-05-29 03:08 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-master-OracleJDK21-nightly/19/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-05-22 21:50 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/17/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-05-15 21:50 - PASSED (unknown):
    https://jenkins.hazelcast.com/job/Hazelcast-master-CorrettoJDK17-arm64-nightly/16/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

----------------------------------------

For branch: 5.5.z
Builds between : 2024-07-31 18:08 - 2024-07-31 18:08
Jobs: 1, Runs: 1, Passed: 1, Failed: 0, Skipped: 0, Fail Ratio: 0.00%
Run on:
+--------------------------------------------------+
| JDK        | PASSED | FAILED | SKIPPED |  RATIO  |
+--------------------------------------------------+
| openjdk-17 |   1    |   0    |    0    |   0.00% |
+--------------------------------------------------+

Builds Timeline:
2024-07-31 18:08 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-ZuluJDK17-nightly/128/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

----------------------------------------

For branch: 5.4.z
Builds between : 2024-06-24 18:02 - 2024-07-29 18:02
Jobs: 3, Runs: 15, Passed: 15, Failed: 0, Skipped: 0, Fail Ratio: 0.00%
Run on:
+--------------------------------------------------+
| JDK        | PASSED | FAILED | SKIPPED |  RATIO  |
+--------------------------------------------------+
| openjdk-17 |   4    |   0    |    0    |   0.00% |
| oracle-21  |   6    |   0    |    0    |   0.00% |
| openj9-21  |   5    |   0    |    0    |   0.00% |
+--------------------------------------------------+

Builds Timeline:
2024-07-29 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/14/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-27 18:06 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-Openj9-21-nightly/13/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-24 18:08 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-ZuluJDK17-nightly/127/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-22 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/13/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-20 18:06 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-Openj9-21-nightly/12/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-17 18:08 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-ZuluJDK17-nightly/126/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-15 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/12/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-13 18:06 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-Openj9-21-nightly/11/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-10 18:08 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-ZuluJDK17-nightly/125/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-08 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/11/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-06 18:06 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-Openj9-21-nightly/10/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-03 18:08 - PASSED (openjdk-17):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-ZuluJDK17-nightly/124/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-01 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/10/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-29 18:06 - PASSED (openj9-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-Openj9-21-nightly/9/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-24 18:02 - PASSED (oracle-21):
    https://jenkins.hazelcast.com/job/Hazelcast-5.maintenance-OracleJDK21-nightly/9/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

----------------------------------------

For branch: 5.3.z
Builds between : 2024-07-01 03:11 - 2024-07-29 03:11
Jobs: 1, Runs: 5, Passed: 5, Failed: 0, Skipped: 0, Fail Ratio: 0.00%
Run on:
+------------------------------------------------+
| JDK      | PASSED | FAILED | SKIPPED |  RATIO  |
+------------------------------------------------+
| oracle-8 |   5    |   0    |    0    |   0.00% |
+------------------------------------------------+

Builds Timeline:
2024-07-29 03:11 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.3.z-OracleJDK8-nightly/13/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-22 03:11 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.3.z-OracleJDK8-nightly/12/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-15 03:11 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.3.z-OracleJDK8-nightly/11/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-08 03:11 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.3.z-OracleJDK8-nightly/10/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-01 03:11 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.3.z-OracleJDK8-nightly/9/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

----------------------------------------

For branch: 5.2.z
Builds between : 2024-06-29 03:10 - 2024-07-27 03:10
Jobs: 1, Runs: 5, Passed: 5, Failed: 0, Skipped: 0, Fail Ratio: 0.00%
Run on:
+------------------------------------------------+
| JDK      | PASSED | FAILED | SKIPPED |  RATIO  |
+------------------------------------------------+
| oracle-8 |   5    |   0    |    0    |   0.00% |
+------------------------------------------------+

Builds Timeline:
2024-07-27 03:10 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.2.z-OracleJDK8-nightly/63/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-20 03:10 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.2.z-OracleJDK8-nightly/62/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-13 03:10 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.2.z-OracleJDK8-nightly/61/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-07-06 03:10 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.2.z-OracleJDK8-nightly/60/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/
2024-06-29 03:10 - PASSED (oracle-8):
    https://jenkins.hazelcast.com/job/Hazelcast-5.2.z-OracleJDK8-nightly/59/testReport/com.hazelcast.jet.core/OperationLossTest/when_terminateExecutionOperationLost_then_jobTerminates/

----------------------------------------

More details can be generated here: Run jenkins build (Click Proceed -> Back to previous page -> Click job name -> Find new build)

olukas commented 1 month ago

Closing the test failure - it doesn't seem to be related to master or the latest maintenance stream 5.5.z and it hasn't fail in the last 3 months. Feel free to reopen test failure if it occurs on master or on the latest maintenance stream.