alibaba / SREWorks

Cloud Native DataOps & AIOps Platform | 云原生数智运维平台
https://sreworks.cn
Apache License 2.0
1.81k stars 401 forks source link

prod-job-job-worker deployment失败 #11

Open stat0s2p opened 2 years ago

stat0s2p commented 2 years ago

SREWorks用helm部署完成,网页能进去,不过和运维相关的功能都提示404错误. 看k8s相关资源,有个sreworks命名空间下的prod-job-job-worker deployment失败了,不知道是不是这个原因.

相关信息: git commit id:e85c723 k8s版本:v1.23.4,v1.23.5 ingress控制器:nginx ingress storageClass:nfs-client 失败的pod log:

[2022-03-24 10:31:21 234] WARN [main][o.s.data.convert.CustomConversions:263]- Registering converter from interface java.util.Map to class org.springframework.data.geo.Point as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation.
[2022-03-24 10:31:21 235] WARN [main][o.s.data.convert.CustomConversions:273]- Registering converter from class org.springframework.data.elasticsearch.core.geo.GeoPoint to interface java.util.Map as writing converter although it doesn't convert to a store-supported type! You might want to check your annotation setup at the converter implementation.
[2022-03-24 10:31:21 235] WARN [main][o.s.data.convert.CustomConversions:263]- Registering converter from interface java.util.Map to class org.springframework.data.elasticsearch.core.geo.GeoPoint as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation.
[2022-03-24 10:31:21 400] INFO [main][o.s.d.e.support.VersionInfo:59]- Version Spring Data Elasticsearch: 4.0.7.RELEASE
[2022-03-24 10:31:21 401] INFO [main][o.s.d.e.support.VersionInfo:60]- Version Elasticsearch Client in build: 7.6.2
[2022-03-24 10:31:21 401] INFO [main][o.s.d.e.support.VersionInfo:61]- Version Elasticsearch Client used: 7.6.2
[2022-03-24 10:31:21 401] INFO [main][o.s.d.e.support.VersionInfo:69]- Version Elasticsearch cluster: 7.10.2
[2022-03-24 10:31:21 401] WARN [main][o.s.d.e.support.VersionInfo:72]- Version mismatch in between Elasticsearch Client and Cluster: 7.6.2 - 7.10.2
[2022-03-24 10:31:21 877] INFO [main][org.reflections.Reflections:229]- Reflections took 68 ms to scan 1 urls, producing 2 keys and 7 values
[2022-03-24 10:31:21 919] INFO [main][o.s.s.c.ThreadPoolTaskExecutor:181]- Initializing ExecutorService
[2022-03-24 10:31:22 177] WARN [main][o.s.b.w.s.c.AnnotationConfigServletWebServerApplicationContext:559]- Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'heartBeatService': Invocation of init method failed; nested exception is java.net.ConnectException
[2022-03-24 10:31:22 178] INFO [main][o.s.s.c.ThreadPoolTaskExecutor:218]- Shutting down ExecutorService
[2022-03-24 10:31:22 181] INFO [main][o.s.o.j.LocalContainerEntityManagerFactoryBean:601]- Closing JPA EntityManagerFactory for persistence unit 'default'
[2022-03-24 10:31:22 184] INFO [main][com.zaxxer.hikari.HikariDataSource:350]- HikariPool-1 - Shutdown initiated...
[2022-03-24 10:31:22 216] INFO [main][com.zaxxer.hikari.HikariDataSource:352]- HikariPool-1 - Shutdown completed.
[2022-03-24 10:31:22 220] INFO [main][o.a.catalina.core.StandardService:173]- Stopping service [Tomcat]
[2022-03-24 10:31:22 250] INFO [main][o.s.b.a.l.ConditionEvaluationReportLoggingListener:136]-
Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
[2022-03-24 10:31:22 257] ERROR [main][o.s.boot.SpringApplication:837]- Application run failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'heartBeatService': Invocation of init method failed; nested exception is java.net.ConnectException
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:160)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:415)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1791)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:594)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:516)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:324)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:322)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:897)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:879)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:551)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:758)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:750)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:405)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:315)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1237)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1226)
at com.alibaba.sreworks.job.WorkerApplication.main(WorkerApplication.java:18)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:107)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:58)
at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88)
Caused by: java.net.ConnectException: null
at java.net.http/jdk.internal.net.http.HttpClientImpl.send(HttpClientImpl.java:563)
at java.net.http/jdk.internal.net.http.HttpClientFacade.send(HttpClientFacade.java:119)
at com.alibaba.sreworks.job.utils.Requests.post(Requests.java:57)
at com.alibaba.sreworks.job.worker.services.HeartBeatService.report(HeartBeatService.java:48)
at com.alibaba.sreworks.job.worker.services.HeartBeatService.init(HeartBeatService.java:41)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:389)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:333)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:157)
... 27 common frames omitted
Caused by: java.net.ConnectException: null
at java.net.http/jdk.internal.net.http.common.Utils.toConnectException(Utils.java:1034)
at java.net.http/jdk.internal.net.http.PlainHttpConnection.connectAsync(PlainHttpConnection.java:179)
at java.net.http/jdk.internal.net.http.Http1Exchange.sendHeadersAsync(Http1Exchange.java:238)
at java.net.http/jdk.internal.net.http.Exchange.lambda$responseAsyncImpl0$8(Exchange.java:435)
at java.net.http/jdk.internal.net.http.Exchange.checkFor407(Exchange.java:367)
at java.net.http/jdk.internal.net.http.Exchange.lambda$responseAsyncImpl0$9(Exchange.java:439)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:930)
at java.base/java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:946)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:2337)
at java.net.http/jdk.internal.net.http.Exchange.responseAsyncImpl0(Exchange.java:439)
at java.net.http/jdk.internal.net.http.Exchange.responseAsyncImpl(Exchange.java:343)
at java.net.http/jdk.internal.net.http.Exchange.responseAsync(Exchange.java:335)
at java.net.http/jdk.internal.net.http.MultiExchange.responseAsyncImpl(MultiExchange.java:347)
at java.net.http/jdk.internal.net.http.MultiExchange.lambda$responseAsyncImpl$7(MultiExchange.java:384)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:930)
at java.base/java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:946)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:2337)
at java.net.http/jdk.internal.net.http.MultiExchange.responseAsyncImpl(MultiExchange.java:374)
at java.net.http/jdk.internal.net.http.MultiExchange.lambda$responseAsync0$2(MultiExchange.java:293)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1146)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1776)
at java.net.http/jdk.internal.net.http.HttpClientImpl$DelegatingExecutor.execute(HttpClientImpl.java:155)
at java.base/java.util.concurrent.CompletableFuture.completeAsync(CompletableFuture.java:2670)
at java.net.http/jdk.internal.net.http.MultiExchange.responseAsync(MultiExchange.java:246)
at java.net.http/jdk.internal.net.http.HttpClientImpl.sendAsync(HttpClientImpl.java:643)
at java.net.http/jdk.internal.net.http.HttpClientImpl.send(HttpClientImpl.java:542)
... 38 common frames omitted
Caused by: java.nio.channels.UnresolvedAddressException: null
at java.base/sun.nio.ch.Net.checkAddress(Net.java:131)
at java.base/sun.nio.ch.SocketChannelImpl.checkRemote(SocketChannelImpl.java:708)
at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:722)
at java.net.http/jdk.internal.net.http.PlainHttpConnection.lambda$connectAsync$0(PlainHttpConnection.java:165)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:554)
at java.net.http/jdk.internal.net.http.PlainHttpConnection.connectAsync(PlainHttpConnection.java:167)
... 63 common frames omitted
sreworks commented 2 years ago
  1. 请确认prod-job-job-master是否成功启动
  2. prod-job-job-master异常通常是es未成功启动,请确认sreworks-dataops这个ns下的es是否成功启动
stat0s2p commented 2 years ago
  1. 请确认prod-job-job-master是否成功启动
  2. prod-job-job-master异常通常是es未成功启动,请确认sreworks-dataops这个ns下的es是否成功启动

prod-job-job-master启动是成功的.下面是其中一个pod的log:

[2022-03-24 18:11:26 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:28 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:28 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:30 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:30 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:31 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:32 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:32 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:34 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:34 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:36 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:36 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:36 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:38 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:38 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:40 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:40 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:41 681] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:42 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:42 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:44 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:44 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:46 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:46 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:46 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:48 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:48 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:50 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:50 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:51 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:52 680] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:52 680] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:54 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:54 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:56 677] INFO [scheduling-1][c.a.t.d.services.DagInstClearService:41]- >>>dagInstClearService|clearDataBefore|exit|costTime=4, delete4DagInst=0, delete4DagInstNode=0, delete4DagInstEdge=0, delete4DagInstNodeStd=0
[2022-03-24 18:11:56 678] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:11:56 680] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:56 680] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:11:58 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:11:58 677] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:00 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:00 680] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:01 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:02 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:02 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:04 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:04 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:06 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:06 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:06 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:08 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:08 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:10 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:10 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:11 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:12 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:12 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:14 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:14 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:16 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:16 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:16 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:18 680] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:18 680] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:20 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:20 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:21 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:22 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:22 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:24 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:24 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:26 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:26 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:26 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:28 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:28 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:30 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:30 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:31 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:32 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:32 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:34 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:34 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:36 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:36 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:36 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:38 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:38 677] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:40 685] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:40 685] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:41 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:42 677] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:42 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:44 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:44 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:46 677] INFO [scheduling-1][c.a.s.j.m.j.d.DagInstFixedRateSchedule:38]- action=taskFlowDispatchJob|execute|exit|timeoutCount=0
[2022-03-24 18:12:46 679] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:46 679] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0
[2022-03-24 18:12:48 678] INFO [scheduling-1][monitor:32]- >>>monitorJob|cost|inst=[0:0.0], nodeStart=[0:0.0], job=[0:0.0], task=[0:0.0], stdout=[0:0.0], status=[0:0.0]
[2022-03-24 18:12:48 678] INFO [scheduling-1][monitor:38]- >>>monitorJob|threadPool|inst=0, node=0, job=0