升级最新版本出现问题

data-sync.log:

java.lang.RuntimeException: p2pDataSyncRestService error 404 at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): *__checkpoint ⇢ 404 NOT_FOUND from POST http://root-kuscia-autonomy-transsion:80/api/v1alpha1/data/sync [DefaultWebClient] Original Stack Trace: at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec$StatusHandler.apply(DefaultWebClient.java:721) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.applyStatusHandlers(DefaultWebClient.java:686) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.handleBodyMono(DefaultWebClient.java:655) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.lambda$bodyToMono$3(DefaultWebClient.java:580) at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:132) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113) at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:180) at reactor.core.publisher.FluxPeekFuseable$PeekConditionalSubscriber.onNext(FluxPeekFuseable.java:854) at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:74) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:122) at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:251) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2571) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.request(FluxContextWrite.java:136) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onSubscribeInner(MonoFlatMapMany.java:150) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onSubscribe(MonoFlatMapMany.java:246) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onSubscribe(FluxContextWrite.java:101) at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68) at reactor.core.publisher.Flux.subscribe(Flux.java:8840) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:196) at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99) at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:178) at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:176) at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435) at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:715) at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205) at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466) at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:725) at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:115) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1407) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:918) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:501) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:399) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:994) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) Suppressed: java.lang.Exception: #block terminated with an error at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:104) at reactor.core.publisher.Mono.block(Mono.java:1779) at org.springframework.web.service.invoker.HttpServiceMethod$ReactorExchangeResponseFunction.execute(HttpServiceMethod.java:417) at org.springframework.web.service.invoker.HttpServiceMethod.invoke(HttpServiceMethod.java:130) at org.springframework.web.service.invoker.HttpServiceProxyFactory$HttpServiceMethodInterceptor.invoke(HttpServiceProxyFactory.java:304) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:223) at jdk.proxy2/jdk.proxy2.$Proxy290.sync(Unknown Source) at org.secretflow.secretpad.persistence.datasync.rest.p2p.P2pDataSyncRestTemplate.send(P2pDataSyncRestTemplate.java:60) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.work(DataSyncJob.java:59) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:78) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:38) at jdk.internal.reflect.GeneratedMethodAccessor357.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:354) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:113) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) 2024-09-04 11:20:36 [DataSyncThreadPool-3] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync send error, retry 3 times, remove it 2024-09-04 11:20:36 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---0 2024-09-04 11:20:36 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - pajdcjfl commit EntityChangeListener.DbChangeEvent(dstNode=pajdcjfl, action=create, dType=org.secretflow.secretpad.persistence.entity.VoteRequestDO, projectId=null, nodeIds=[hhneesen, pajdcjfl], source=VoteRequestDO(voteID=6fc6a71dc77b4e08a31f91d08d283a93, initiator=hhneesen, voters=[pajdcjfl], type=PROJECT_CREATE, voteCounter=hhneesen, executors=[transsion, transsion], approvedThreshold=1, requestMsg={"body":"eyJhcHByb3ZlZF9hY3Rpb24iOiJQUk9KRUNUX0NSRUFURSx7XCJwcm9qZWN0RE9cIjp7XCJjb21wdXRlRnVuY1wiOlwiREFHXCIsXCJjb21wdXRlTW9kZVwiOlwiTVBDXCIsXCJnbXRDcmVhdGVcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI0LTA5LTA0IDExOjIwOjM2XCIsXCJpZFwiOjExLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJuYW1lXCI6XCLlvIDlj5Hpqozor4EwOTAzXCIsXCJub2RlSWRzXCI6W10sXCJvd25lcklkXCI6XCJoaG5lZXNlblwiLFwicHJvamVjdElkXCI6XCJkY21lYXF1Z1wiLFwicHJvamVjdEluZm9cIjp7fSxcInN0YXR1c1wiOjF9LFwicHJvamVjdEluc3RET1NcIjpbe1wiZ210Q3JlYXRlXCI6XCIyMDI0LTA5LTA0IDAzOjIwOjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJpbnN0SWRcIjpcImhobmVlc2VuXCIsXCJwcm9qZWN0SWRcIjpcImRjbWVhcXVnXCJ9fSx7XCJnbXRDcmVhdGVcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI0LTA5LTA0IDAzOjIwOjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcImluc3RJZFwiOlwicGFqZGNqZmxcIixcInByb2plY3RJZFwiOlwiZGNtZWFxdWdcIn19XSxcInByb2plY3ROb2RlRE9TXCI6W3tcImdtdENyZWF0ZVwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wibm9kZUlkXCI6XCJ0cmFuc3Npb25cIixcInByb2plY3RJZFwiOlwiZGNtZWFxdWdcIn19LHtcImdtdENyZWF0ZVwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wibm9kZUlkXCI6XCJwYWxtcGF5XCIsXCJwcm9qZWN0SWRcIjpcImRjbWVhcXVnXCJ9fV19IiwiYXBwcm92ZWRfdGhyZXNob2xkIjoxLCJleGVjdXRvcnMiOlsidHJhbnNzaW9uIl0sImluaXRpYXRvciI6ImhobmVlc2VuIiwicmVqZWN0ZWRfYWN0aW9uIjoiUFJPSkVDVF9BUkNISVZFLHtcInByb2plY3RET1wiOntcImNvbXB1dGVGdW5jXCI6XCJEQUdcIixcImNvbXB1dGVNb2RlXCI6XCJNUENcIixcImdtdENyZWF0ZVwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjQtMDktMDQgMTE6MjA6MzZcIixcImlkXCI6MTEsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcIm5hbWVcIjpcIuW8gOWPkemqjOivgTA5MDNcIixcIm5vZGVJZHNcIjpbXSxcIm93bmVySWRcIjpcImhobmVlc2VuXCIsXCJwcm9qZWN0SWRcIjpcImRjbWVhcXVnXCIsXCJwcm9qZWN0SW5mb1wiOnt9LFwic3RhdHVzXCI6Mn0sXCJwcm9qZWN0SW5zdERPU1wiOlt7XCJnbXRDcmVhdGVcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI0LTA5LTA0IDAzOjIwOjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcImluc3RJZFwiOlwiaGhuZWVzZW5cIixcInByb2plY3RJZFwiOlwiZGNtZWFxdWdcIn19LHtcImdtdENyZWF0ZVwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjQtMDktMDQgMDM6MjA6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wiaW5zdElkXCI6XCJwYWpkY2pmbFwiLFwicHJvamVjdElkXCI6XCJkY21lYXF1Z1wifX1dLFwicHJvamVjdE5vZGVET1NcIjpbe1wiZ210Q3JlYXRlXCI6XCIyMDI0LTA5LTA0IDAzOjIwOjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJub2RlSWRcIjpcInRyYW5zc2lvblwiLFwicHJvamVjdElkXCI6XCJkY21lYXF1Z1wifX0se1wiZ210Q3JlYXRlXCI6XCIyMDI0LTA5LTA0IDAzOjIwOjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNC0wOS0wNCAwMzoyMDozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJub2RlSWRcIjpcInBhbG1wYXlcIixcInByb2plY3RJZFwiOlwiZGNtZWFxdWdcIn19XX0iLCJ0eXBlIjoiUFJPSkVDVF9DUkVBVEUiLCJ2b3RlX2NvdW50ZXIiOiJoaG5lZXNlbiIsInZvdGVfcmVxdWVzdF9pZCI6IjZmYzZhNzFkYzc3YjRlMDhhMzFmOTFkMDhkMjgzYTkzIiwidm90ZXJzIjpbInBhamRjamZsIl19","cert_chain":["LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMxRENDQWJ5Z0F3SUJBZ0lFSzdyZEZqQU5CZ2txaGtpRzl3MEJBUXNGQURBVU1SSXdFQVlEVlFRREV3bDAKY21GdWMzTnBiMjR3SGhjTk1qUXdPVEEwTURNeU1ETTJXaGNOTWpRd09UQTFNRE15TURNMldqQVBNUTB3Q3dZRApWUVFERXdSMmIzUmxNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXQzL3ZncStwCmhGK2tLTWEzQVJIVnBqaEllWWMwRnFDQkJBak8wcE8rb2xCalp1SUJLWGYyTmVIVmpDazAwWDZ1ZG5hc1ExQ3EKV2JhQmc5M0lpSUdpc1VpSUxqdjM4NFFEUnI2U1FsS0ZTaHR3dEpMSk9XSWZicU9aa0JoRUdUSHpHQjdqL2tvSAo5K09zT2lxR05kS1VzK0RmVHBVMEtZSktUbjZpWUFDZC9NT3NneEM5MUxBNi83d3ljS0lndzlGaVluT0ZRd2MxCkVkNWNBWExHbHllT2FIczRtNGwwUVpXYTdtV3JIUGd5MDdsYmxEdDZ0eGozRDRhbnl6NVoybTdQVWNFN0tsUnoKMlJLYlFOaWtNd3lsOTBsR3RBUEZaWXZDZkFVTDQwVGplWXovdStwMlRuaWdHQm5mc3g5M01QRHAwakxoc2gwZgo3aGFBRzBYbTd3T2lrUUlEQVFBQm96TXdNVEFPQmdOVkhROEJBZjhFQkFNQ0JhQXdId1lEVlIwakJCZ3dGb0FVCkVDSFgwOVJ0VTJtRzZXVlZMWUlQWHdpSk90a3dEUVlKS29aSWh2Y05BUUVMQlFBRGdnRUJBRFpOaUZXbWRWbTAKbUVsQi9xZW5CckpuWnRtYVBxSGduSTllRUpSajVTREVxUFFBNGZWbWpvZWFHQjlkMWtGd0p5UU5mR1pYRmFmYgovRVhBOXg2cGhNMXkxd2xLSFhJYnpiaTBjY2xGMitlUEFyQnZvelpwKzQ5T2dHcWNDSnlRV243Z1ZqcjJrckd3CklVVTlTaGxsaGpKajc1akhPVHhsUC9wTE96STlYbjZ1OXg2bURkNUk0YVU1N3lGUkx0dW90YWljMTlEaVpZTVkKZDNsV0JwdnQvZGtqWmxSSGl6YUY4SjdaTFlkNVQ3Q242eDBXVzR1cWxNUEYrMFV3ZDFrNGxtb2pKZnNoRG5PQwpZYUdxd0JtWUlSRXhlaXhRQ0MrNVZOeWwwZnZuTktndDByTXJ2ZjJtQ3FIQTNMYUpvLzhkbDYvaWNQZkRYZUNxCllkOE5zZEI3N3U0PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==","LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCakNDQWU2Z0F3SUJBZ0lCQVRBTkJna3Foa2lHOXcwQkFRc0ZBREFVTVJJd0VBWURWUVFERXdsMGNtRnUKYzNOcGIyNHdJQmNOTWpRd09UQTBNREl5TXpReldoZ1BNakEzTkRBNU1EUXdNakl6TkROYU1CUXhFakFRQmdOVgpCQU1UQ1hSeVlXNXpjMmx2YmpDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTStoCm5QOEtrWGdlTFlYdEoxY3FCbWlsbDhkZDFsVmNsZ2hndUI0bFRWQ3lraWNidGNYb0ZrQ0FqYmx3T2xxVWV4MG0Kd29xb3BoaXpiSWh0MGh4c0lYTDN2SFBwSVpTN2NENUhiWTUwOSt5MFc0TGd4MmI4bjZCeGZ1M0tjOUtnd2YvZApBaVU5WDRyR3liaStjaUtXelppS0hPM1o2R3NpZHExVk5BT3diTEZPM0srbEZ1dldyb05KTEp5Ly93S0ZFb0pQCnkvdFc5ei9lTjlRc0xOQ3hBeStUcVVSZWNRSFlTTXNmcFBjbG5sOGY5c1FOQ1BZZGxRZ0NYaDJCQ1NuWHdIcXgKQkFFTWtCSXBYZmNUdG1FTyswTjRHRWd5NFJRaU15TjJwN2Qwd0xOcldobE43VGZyU0pqZ2FZc0NxdUZDVG5jeQpac016VEJSZ2h3aTJxRFNZV3VrQ0F3RUFBYU5oTUY4d0RnWURWUjBQQVFIL0JBUURBZ0tFTUIwR0ExVWRKUVFXCk1CUUdDQ3NHQVFVRkJ3TUNCZ2dyQmdFRkJRY0RBVEFQQmdOVkhSTUJBZjhFQlRBREFRSC9NQjBHQTFVZERnUVcKQkJRUUlkZlQxRzFUYVlicFpWVXRnZzlmQ0lrNjJUQU5CZ2txaGtpRzl3MEJBUXNGQUFPQ0FRRUFOWFE3TXJISQpEYWY0aCtMQlhqejVNSHE3NW5zRjR6WVZTcUVpdG1oeGk4T0xFMCtoOFY4amwwRXYrOHpDemY1elFnWVdaMmwzClVzVE5HdmlFOVZsNk5xVUZjRUJvT3owU2VuZkZPVE5UeFJZUlVmL3RON2oxS2tFZzlFTVVzcWU2WmFIaloxRjQKU0l0RFczNUhWVUk5RW83eFBna3laYkNtc1hVelQ1TWEyTXZVMytlSjdva1VtUzBUaHQ0YUYrK1ozd3lDT3pEcApxRUhVdTgrQ3lTbStaLy81R0dnREc0SkZ5ZXZ5UDVJcU5WYjZHUUF3ZFo5b0IrWk9xYXdCYzduTk1UbWNIYnl4CkFQWVJacHZBRzZhTG5YZ1VQREJTOTFBN004S2JtKzk0Y05oYTJzVEhYSkY1RWFiK3MwNkFaM2JLNThkZDdYdGgKbVh4RVVtUVRNYnJsM0E9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg=="],"vote_request_signature":"tM4OHeEslldYcYOBl+p2GFyaiCZl1GF8ao5KohTYg4qIqhGe4FFlDw2MmrruNt05PZUbY16XLPVVTIwRdbVDwiAdEHz+y18GY35sJOH2ooBYpJJ1h5Y/hDvIFX7wyqlVqUbOV9h+xeo3p4lptwTpPiKNdJCClXMU88i5oILbLLRallQLtqU2LgxgHN+9CK2c5NwIOL1PvhlcelejGPLTbG9hxl/kO/oyz+XrJoP9U3UsMcvSmuwtp3iB/ThD2kjmjN/TWo3/LyRkh92leLhk42rLw/9ocUzaqan5K8XN51/a+a5vPA3Gjm17lgV4ObyQZVBDodOrPCA+WKmZs6YXYg=="}, status=0, executeStatus=COMMITTED, msg=null, desc=开发验证0903, partyVoteInfos=[VoteRequestDO.PartyVoteInfo(partyId=pajdcjfl, action=REVIEWING, reason=null), VoteRequestDO.PartyVoteInfo(partyId=hhneesen, action=APPROVED, reason=null)])) 2024-09-04 11:20:36 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send pajdcjfl, now size 0 2024-09-04 11:20:36 [DataSyncThreadPool-7] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send error java.lang.RuntimeException: p2pDataSyncRestService error 404 at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): *__checkpoint ⇢ 404 NOT_FOUND from POST http://root-kuscia-autonomy-transsion:80/api/v1alpha1/data/sync [DefaultWebClient] Original Stack Trace: at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec$StatusHandler.apply(DefaultWebClient.java:721) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.applyStatusHandlers(DefaultWebClient.java:686) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.handleBodyMono(DefaultWebClient.java:655) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.lambda$bodyToMono$3(DefaultWebClient.java:580) at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:132) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113) at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:180) at reactor.core.publisher.FluxPeekFuseable$PeekConditionalSubscriber.onNext(FluxPeekFuseable.java:854) at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:74) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:122) at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:251) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2571) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.request(FluxContextWrite.java:136) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onSubscribeInner(MonoFlatMapMany.java:150) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onSubscribe(MonoFlatMapMany.java:246) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onSubscribe(FluxContextWrite.java:101) at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68) at reactor.core.publisher.Flux.subscribe(Flux.java:8840) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:196) at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99) at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:178) at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:176) at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435) at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:715) at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205) at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466) at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:725) at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:115) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1407) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:918) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:501) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:399) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:994) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) Suppressed: java.lang.Exception: #block terminated with an error at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:104) at reactor.core.publisher.Mono.block(Mono.java:1779) at org.springframework.web.service.invoker.HttpServiceMethod$ReactorExchangeResponseFunction.execute(HttpServiceMethod.java:417) at org.springframework.web.service.invoker.HttpServiceMethod.invoke(HttpServiceMethod.java:130) at org.springframework.web.service.invoker.HttpServiceProxyFactory$HttpServiceMethodInterceptor.invoke(HttpServiceProxyFactory.java:304) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:223) at jdk.proxy2/jdk.proxy2.$Proxy290.sync(Unknown Source) at org.secretflow.secretpad.persistence.datasync.rest.p2p.P2pDataSyncRestTemplate.send(P2pDataSyncRestTemplate.java:60) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.work(DataSyncJob.java:59) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:78) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:38) at jdk.internal.reflect.GeneratedMethodAccessor357.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:354) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:113) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) 2024-09-04 11:20:36 [DataSyncThreadPool-7] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync send error, retry 3 times, remove it 2024-09-04 11:20:36 [DataSyncThreadPool-7] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---0 2024-09-04 11:20:36 [DataSyncThreadPool-7] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - pajdcjfl commit EntityChangeListener.DbChangeEvent(dstNode=pajdcjfl, action=update, dType=org.secretflow.secretpad.persistence.entity.ProjectDO, projectId=dcmeaqug, nodeIds=[hhneesen, pajdcjfl], source=ProjectDO(projectId=dcmeaqug, name=开发验证0903, description=null, computeMode=MPC, computeFunc=DAG, projectInfo=ProjectInfoDO(teeDomainId=null), ownerId=hhneesen, status=0)) 2024-09-04 11:20:36 [DataSyncThreadPool-7] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send pajdcjfl, now size 0 2024-09-04 11:20:36 [DataSyncThreadPool-1] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send error java.lang.RuntimeException: p2pDataSyncRestService error 404 at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): *__checkpoint ⇢ 404 NOT_FOUND from POST http://root-kuscia-autonomy-transsion:80/api/v1alpha1/data/sync [DefaultWebClient] Original Stack Trace: at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:124) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec$StatusHandler.apply(DefaultWebClient.java:721) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.applyStatusHandlers(DefaultWebClient.java:686) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.handleBodyMono(DefaultWebClient.java:655) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.lambda$bodyToMono$3(DefaultWebClient.java:580) at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:132) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113) at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:180) at reactor.core.publisher.FluxPeekFuseable$PeekConditionalSubscriber.onNext(FluxPeekFuseable.java:854) at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:74) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:122) at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:251) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2571) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.request(FluxContextWrite.java:136) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onSubscribeInner(MonoFlatMapMany.java:150) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onSubscribe(MonoFlatMapMany.java:246) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onSubscribe(FluxContextWrite.java:101) at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68) at reactor.core.publisher.Flux.subscribe(Flux.java:8840) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:196) at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99) at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:178) at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:176) at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435) at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:715) at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205) at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466) at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:725) at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:115) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1407) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:918) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:501) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:399) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:994) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) Suppressed: java.lang.Exception: #block terminated with an error at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:104) at reactor.core.publisher.Mono.block(Mono.java:1779) at org.springframework.web.service.invoker.HttpServiceMethod$ReactorExchangeResponseFunction.execute(HttpServiceMethod.java:417) at org.springframework.web.service.invoker.HttpServiceMethod.invoke(HttpServiceMethod.java:130) at org.springframework.web.service.invoker.HttpServiceProxyFactory$HttpServiceMethodInterceptor.invoke(HttpServiceProxyFactory.java:304) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:223) at jdk.proxy2/jdk.proxy2.$Proxy290.sync(Unknown Source) at org.secretflow.secretpad.persistence.datasync.rest.p2p.P2pDataSyncRestTemplate.send(P2pDataSyncRestTemplate.java:60) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.work(DataSyncJob.java:59) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:78) at org.secretflow.secretpad.persistence.datasync.job.DataSyncJob.onApplicationEvent(DataSyncJob.java:38) at jdk.internal.reflect.GeneratedMethodAccessor357.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:354) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:113) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840)

secretflow / secretpad

升级最新版本出现问题 #134

Issue Type

Have you searched for existing issues?

Link to Relevant Documentation

Question Details