search

redis / riot

🧨 Get data in & out of Redis with RIOT
http://redis.github.io/riot
Apache License 2.0
277 stars 39 forks source link

Redis failed to synchronize data #152

Open huangyukang-L opened 4 months ago

huangyukang-L commented 4 months ago

The following is an error message in debug mode for executing synchronization：/services/riot-3.1.5/bin/riot -d -n 8 -h xxxx -p 6379 replicate -h xxxx -p 6379 -a xxxx --threads 2 -n 8 --type=ds 09:11:13.555 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Applying contribution: [StepContribution: read=50, written=0, filtered=0, readSkips=0, writeSkips=0, processSkips=0, exitStatus=EXECUTING] 09:11:13.556 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Rollback for RuntimeException: java.lang.NumberFormatException: For input string: "inf" 09:11:13.556 FINE org.springframework.transaction.support.TransactionTemplate : Initiating transaction rollback on application exception java.lang.NumberFormatException: For input string: "inf" at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054) at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110) at java.base/java.lang.Double.parseDouble(Double.java:543) at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68) at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56) at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193) at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159) at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294) at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.556 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction rollback 09:11:13.556 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Rolling back resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@3ba541d2] 09:11:13.556 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: java.lang.NumberFormatException, caused by: java.lang.NumberFormatException: For input string: "inf" 09:11:13.556 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): java.lang.NumberFormatException: For input string: "inf" 09:11:13.556 SEVERE org.springframework.batch.core.step.AbstractStep : Encountered an error executing step scan-reader in job scan-reader java.lang.NumberFormatException: For input string: "inf" at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054) at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110) at java.base/java.lang.Double.parseDouble(Double.java:543) at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68) at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56) at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193) at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159) at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294) at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@ec0094] 09:11:13.558 INFO org.springframework.batch.core.step.AbstractStep : Step: [scan-reader] executed in 8s128ms 09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.559 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.559 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@24c38393] 09:11:13.561 FINE org.springframework.batch.core.step.AbstractStep : Step execution complete: StepExecution: id=2, version=201, name=scan-reader, status=FAILED, exitStatus=FAILED, readCount=10000, filterCount=0, writeCount=9950 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=199, rollbackCount=1 09:11:13.561 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.562 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.562 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@537c9c8] 09:11:13.562 FINE org.springframework.batch.core.job.AbstractJob : Upgrading JobExecution status: StepExecution: id=2, version=201, name=scan-reader, status=FAILED, exitStatus=FAILED, readCount=10000, filterCount=0, writeCount=9950 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=199, rollbackCount=1, exitDescription=java.lang.NumberFormatException: For input string: "inf" at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054) at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110) at java.base/java.lang.Double.parseDouble(Double.java:543) at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68) at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56) at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193) at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159) at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294) at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.565 FINE org.springframework.batch.core.job.AbstractJob : Job execution complete: JobExecution: id=1, version=1, startTime=Fri Jul 05 09:11:05 UTC 2024, endTime=null, lastUpdated=Fri Jul 05 09:11:05 UTC 2024, status=FAILED, exitStatus=exitCode=FAILED;exitDescription=java.lang.NumberFormatException: For input string: "inf" at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054) at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110) at java.base/java.lang.Double.parseDouble(Double.java:543) at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68) at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40) at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20) at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58) at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56) at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193) at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159) at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294) at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at java.base/java.lang.Thread.run(Thread.java:829) , job=[JobInstance: id=1, version=0, Job=[scan-reader]], jobParameters=[{}] 09:11:13.566 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.568 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.576 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@1d7b488c] 09:11:13.577 INFO org.springframework.batch.core.launch.support.SimpleJobLauncher : Job: [SimpleJob: [name=scan-reader]] completed with the following parameters: [{}] and the following status: [FAILED] in 8s158ms 09:11:13.629 FINE org.springframework.batch.core.step.item.FaultTolerantChunkProvider : Reader job failed : org.springframework.batch.item.ItemStreamException 09:11:13.629 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: org.springframework.batch.core.step.skip.NonSkippableReadException, caused by: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read 09:11:13.629 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read 09:11:13.630 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Applying contribution: [StepContribution: read=50, written=0, filtered=0, readSkips=0, writeSkips=0, processSkips=0, exitStatus=EXECUTING] 09:11:13.630 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Rollback for RuntimeException: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read 09:11:13.630 FINE org.springframework.transaction.support.TransactionTemplate : Initiating transaction rollback on application exception org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105) at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37) at picocli.CommandLine.executeUserObject(CommandLine.java:2041) at picocli.CommandLine.access$1500(CommandLine.java:148) at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461) at picocli.CommandLine$RunLast.handle(CommandLine.java:2453) at picocli.CommandLine$RunLast.handle(CommandLine.java:2415) at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273) at picocli.CommandLine$RunLast.execute(CommandLine.java:2417) at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42) at picocli.CommandLine.execute(CommandLine.java:2170) at com.redis.riot.cli.Main.execute(Main.java:59) at com.redis.riot.cli.Main.main(Main.java:47) Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241) at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42) at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99) at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87) ... 36 more

09:11:13.630 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction rollback 09:11:13.630 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Rolling back resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@2aafd790] 09:11:13.630 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: org.springframework.batch.core.step.skip.NonSkippableReadException, caused by: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read 09:11:13.630 FINE org.springframework.batch.core.step.item.SimpleRetryExceptionHandler : Handled fatal exception 09:11:13.630 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read 09:11:13.630 SEVERE org.springframework.batch.core.step.AbstractStep : Encountered an error executing step scan in job replicate org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105) at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37) at picocli.CommandLine.executeUserObject(CommandLine.java:2041) at picocli.CommandLine.access$1500(CommandLine.java:148) at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461) at picocli.CommandLine$RunLast.handle(CommandLine.java:2453) at picocli.CommandLine$RunLast.handle(CommandLine.java:2415) at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273) at picocli.CommandLine$RunLast.execute(CommandLine.java:2417) at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42) at picocli.CommandLine.execute(CommandLine.java:2170) at com.redis.riot.cli.Main.execute(Main.java:59) at com.redis.riot.cli.Main.main(Main.java:47) Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241) at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42) at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99) at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87) ... 36 more Scanning 100% [==============================================================================================================================================================================] 12937/12937 (0:00:08 / 0:00:00) 1617.1/s 09:11:13.643 FINE org.jline : Removing shutdown-hook: Thread[JLine Shutdown Hook,5,main] 09:11:13.654 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.654 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@226346d4] 09:11:13.655 INFO org.springframework.batch.core.step.AbstractStep : Step: [scan] executed in 8s588ms 09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@66d0d5ee] 09:11:13.655 FINE org.springframework.batch.core.step.AbstractStep : Step execution complete: StepExecution: id=1, version=101, name=scan, status=FAILED, exitStatus=FAILED, readCount=9950, filterCount=0, writeCount=9900 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=99, rollbackCount=1 09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.656 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.656 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@738a1324] 09:11:13.656 FINE org.springframework.batch.core.job.AbstractJob : Upgrading JobExecution status: StepExecution: id=1, version=101, name=scan, status=FAILED, exitStatus=FAILED, readCount=9950, filterCount=0, writeCount=9900 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=99, rollbackCount=1, exitDescription=org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105) at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37) at picocli.CommandLine.executeUserObject(CommandLine.java:2041) at picocli.CommandLine.access$1500(CommandLine.java:148) at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461) at picocli.CommandLine$RunLast.handle(CommandLine.java:2453) at picocli.CommandLine$RunLast.handle(CommandLine.java:2415) at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273) at picocli.CommandLine$RunLast.execute(CommandLine.java:2417) at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42) at picocli.CommandLine.execute(CommandLine.java:2170) at com.redis.riot.cli.Main.execute(Main.java:59) at com.redis.riot.cli.Main.main(Main.java:47) Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241) at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42) at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99) at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87) ... 36 more

09:11:13.656 FINE org.springframework.batch.core.job.AbstractJob : Job execution complete: JobExecution: id=0, version=1, startTime=Fri Jul 05 09:11:05 UTC 2024, endTime=null, lastUpdated=Fri Jul 05 09:11:05 UTC 2024, status=FAILED, exitStatus=exitCode=FAILED;exitDescription=org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105) at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118) at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152) at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413) at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149) at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128) at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37) at picocli.CommandLine.executeUserObject(CommandLine.java:2041) at picocli.CommandLine.access$1500(CommandLine.java:148) at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461) at picocli.CommandLine$RunLast.handle(CommandLine.java:2453) at picocli.CommandLine$RunLast.handle(CommandLine.java:2415) at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273) at picocli.CommandLine$RunLast.execute(CommandLine.java:2417) at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42) at picocli.CommandLine.execute(CommandLine.java:2170) at com.redis.riot.cli.Main.execute(Main.java:59) at com.redis.riot.cli.Main.main(Main.java:47) Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241) at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42) at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99) at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87) ... 36 more , job=[JobInstance: id=0, version=0, Job=[replicate]], jobParameters=[{}] 09:11:13.662 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT 09:11:13.663 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit 09:11:13.663 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@59df8444] 09:11:13.663 INFO org.springframework.batch.core.launch.support.SimpleJobLauncher : Job: [SimpleJob: [name=replicate]] completed with the following parameters: [{}] and the following status: [FAILED] in 8s632ms

jruaux commented 1 month ago

Can you try with latest RIOT release?