github-actions[bot]
commented
2 years ago :blush: Welcome to the Apache Linkis (incubating) community!! We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context. We will be here shortly.
If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.
WeChat Group:
Mailing Lists: |
name | description | Subscribe | Unsubscribe | archive |
|---|---|---|---|---|---|
| dev@linkis.apache.org | community activity information | subscribe | unsubscribe | archive |
casionone
jasonmrliu
Yiutto
Search before asking
Linkis Component
linkis-engineconnn-plugin
Steps to reproduce
sh linkis-cli -submitUser hadoop -engineType spark-2.2.0.cloudera1 -codeType sql -code "show tables"，测试spark引擎状态，报错，控制台错误如下：2022-08-12 20:15:19.015 INFO Program is substituting variables for you 2022-08-12 20:15:19.015 INFO Variables substitution ended successfully 2022-08-12 20:15:20.015 WARN The code you submit will not be limited by the limit Job with jobId : LINKISCLI_hadoop_spark_0 and execID : LINKISCLI_hadoop_spark_0 submitted 2022-08-12 20:15:21.015 INFO You have submitted a new job, script code (after variable substitution) is ****SCRIPT CODE**** show tables ****SCRIPT CODE**** 2022-08-12 20:15:21.015 INFO Your job is accepted, jobID is LINKISCLI_hadoop_spark_0 and jobReqId is 33 in ServiceInstance(linkis-cg-entrance, 172.18.192.103:9104). Please wait it to be scheduled job is scheduled. 2022-08-12 20:15:21.015 INFO Your job is Scheduled. Please wait it to run. Your job is being scheduled by orchestrator. 2022-08-12 20:15:21.015 INFO job is running. 2022-08-12 20:15:21.015 INFO Your job is Running now. Please wait it to complete. 2022-08-12 20:15:21.015 INFO Job with jobGroupId : 33 and subJobId : 32 was submitted to Orchestrator. 2022-08-12 20:15:21.015 INFO Background is starting a new engine for you,execId astJob_0_codeExec_0 mark id is mark_0, it may take several seconds, please wait 2022-08-12 20:15:42.015 ERROR Job with execId-LINKISCLI_hadoop_spark_0 + subJobId : 32 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: 172.18.192.103:9101_0 Failed to async get EngineNode AMErrorException: errCode: 30002 ,desc: ServiceInstance(linkis-cg-engineconn, 172.18.192.103:16786) ticketID:543ec8fe-9406-446a-88f8-351d56e34d2c 初始化引擎失败,原因: Failed to start EngineConn, reason: ECMErrorException: errCode: 11102 ,desc: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=250m; support was removed in 8.0 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/appcom/tmp/engineConnPublickDir/315bd4d0-f2c4-49a5-ae3c-835618c55fed/v000003/lib/log4j-slf4j-impl-2.17.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 20:15:40.608 ERROR org.springframework.boot.SpringApplication 834 reportFailure - Application run failed org.springframework.context.ApplicationContextException: Failed to start bean 'webServerStartStop'; nested exception is org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:895) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:554) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:755) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:402) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.apache.linkis.DataWorkCloudApplication.main(DataWorkCloudApplication.java:121) ~[linkis-module-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook.beforeCreateEngineConn(CallbackEngineConnHook.scala:54) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.8.jar:?] at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.8.jar:?] at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] Caused by: org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:194) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more Caused by: java.lang.IllegalStateException at org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:347) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:730) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_141] at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) ~[?:1.8.0_141] at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) ~[?:1.8.0_141] at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_141] at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:755) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext$JettyEmbeddedServletHandler.deferredInitialize(JettyEmbeddedWebAppContext.java:46) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext.deferredInitialize(JettyEmbeddedWebAppContext.java:36) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.handleDeferredInitialize(JettyWebServer.java:233) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:169) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more 20:15:40.618 ERROR org.apache.linkis.common.utils.Logging$class 58 error - EngineConnServer Start Failed. org.springframework.context.ApplicationContextException: Failed to start bean 'webServerStartStop'; nested exception is org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:895) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:554) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:755) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:402) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.apache.linkis.DataWorkCloudApplication.main(DataWorkCloudApplication.java:121) ~[linkis-module-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook.beforeCreateEngineConn(CallbackEngineConnHook.scala:54) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.8.jar:?] at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.8.jar:?] at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] Caused by: org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:194) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more Caused by: java.lang.IllegalStateException at org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:347) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:730) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_141] at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) ~[?:1.8.0_141] at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) ~[?:1.8.0_141] at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_141] at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:755) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext$JettyEmbeddedServletHandler.deferredInitialize(JettyEmbeddedWebAppContext.java:46) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext.deferredInitialize(JettyEmbeddedWebAppContext.java:36) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.handleDeferredInitialize(JettyWebServer.java:233) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:169) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more 20:15:40.641 ERROR org.apache.linkis.engineconn.callback.service.AbstractEngineConnStartUpCallback 46 callback - protocol will send to em: EngineConnStatusCallback(ServiceInstance(linkis-cg-engineconn, 172.18.192.103:16786),543ec8fe-9406-446a-88f8-351d56e34d2c,Failed,ServiceInstance(linkis-cg-engineconn, 172.18.192.103:16786): log dir: /appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/logs,IllegalStateException: ) 20:15:40.682 ERROR org.apache.linkis.common.utils.Utils$$anonfun$tryAndError$1 107 apply - java.lang.IllegalStateException: org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@7b80af04 has not been refreshed yet at org.springframework.context.support.AbstractApplicationContext.assertBeanFactoryActive(AbstractApplicationContext.java:1096) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.getBeansOfType(AbstractApplicationContext.java:1242) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.apache.linkis.rpc.RPCSpringBeanCache$.getRPCInterceptors(RPCSpringBeanCache.scala:68) ~[linkis-rpc-1.1.1.jar:1.1.1] at org.apache.linkis.rpc.sender.SpringMVCRPCSender.getRPCInterceptors(SpringMVCRPCSender.scala:43) ~[linkis-rpc-1.1.1.jar:1.1.1] at org.apache.linkis.rpc.BaseRPCSender.execute(BaseRPCSender.scala:77) ~[linkis-rpc-1.1.1.jar:1.1.1] at org.apache.linkis.rpc.BaseRPCSender.sendIt(BaseRPCSender.scala:98) ~[linkis-rpc-1.1.1.jar:1.1.1] at org.apache.linkis.rpc.BaseRPCSender.send(BaseRPCSender.scala:107) ~[linkis-rpc-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.service.AbstractEngineConnStartUpCallback.callback(EngineConnCallback.scala:53) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook$$anonfun$afterEngineServerStartFailed$1.apply$mcV$sp(CallbackEngineConnHook.scala:68) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook$$anonfun$afterEngineServerStartFailed$1.apply(CallbackEngineConnHook.scala:68) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook$$anonfun$afterEngineServerStartFailed$1.apply(CallbackEngineConnHook.scala:68) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1] at org.apache.linkis.common.utils.Utils$.tryAndError(Utils.scala:97) ~[linkis-common-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook.afterEngineServerStartFailed(CallbackEngineConnHook.scala:68) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$16.apply(EngineConnServer.scala:81) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$16.apply(EngineConnServer.scala:81) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.8.jar:?] at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.8.jar:?] at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:81) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] 20:15:40.684 ERROR org.apache.linkis.common.utils.Logging$class 58 error - EngineConnSever start failed! now exit. org.springframework.context.ApplicationContextException: Failed to start bean 'webServerStartStop'; nested exception is org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:895) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:554) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:755) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:402) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.apache.linkis.DataWorkCloudApplication.main(DataWorkCloudApplication.java:121) ~[linkis-module-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook.beforeCreateEngineConn(CallbackEngineConnHook.scala:54) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.8.jar:?] at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.8.jar:?] at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] Caused by: org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:194) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more Caused by: java.lang.IllegalStateException at org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:347) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:730) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_141] at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) ~[?:1.8.0_141] at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) ~[?:1.8.0_141] at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_141] at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:755) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext$JettyEmbeddedServletHandler.deferredInitialize(JettyEmbeddedWebAppContext.java:46) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext.deferredInitialize(JettyEmbeddedWebAppContext.java:36) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.handleDeferredInitialize(JettyWebServer.java:233) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:169) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more 20:15:40.686 ERROR org.apache.linkis.common.utils.Logging$class 58 error - process exit reason: org.springframework.context.ApplicationContextException: Failed to start bean 'webServerStartStop'; nested exception is org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:895) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:554) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:755) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:402) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.apache.linkis.DataWorkCloudApplication.main(DataWorkCloudApplication.java:121) ~[linkis-module-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.callback.hook.CallbackEngineConnHook.beforeCreateEngineConn(CallbackEngineConnHook.scala:54) ~[linkis-callback-service-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer$$anonfun$main$5.apply(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.8.jar:?] at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.8.jar:?] at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:61) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.1.1.jar:1.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[spark-core_2.11-2.2.0.cloudera1.jar:2.2.0.cloudera1] Caused by: org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:194) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more Caused by: java.lang.IllegalStateException at org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:347) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604] at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:730) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_141] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_141] at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) ~[?:1.8.0_141] at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) ~[?:1.8.0_141] at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_141] at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:755) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext$JettyEmbeddedServletHandler.deferredInitialize(JettyEmbeddedWebAppContext.java:46) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyEmbeddedWebAppContext.deferredInitialize(JettyEmbeddedWebAppContext.java:36) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.handleDeferredInitialize(JettyWebServer.java:233) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:169) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE] at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE] ... 28 more ,ip: 172.18.192.103 ,port: 9102 ,serviceKind: linkis-cg-engineconnmanager You can go to this path(/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/logs) to find the reason or ask the administrator for help ,ip: 172.18.192.103 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: 172.18.192.103 ,port: 9104 ,serviceKind: linkis-cg-entrance
2022-08-12 20:15:43.015 INFO job is completed. 2022-08-12 20:15:43.015 INFO Task creation time(任务创建时间): 2022-08-12 20:15:18, Task scheduling time(任务调度时间): 2022-08-12 20:15:21, Task start time(任务开始时间): 2022-08-12 20:15:21, Mission end time(任务结束时间): 2022-08-12 20:15:43 2022-08-12 20:15:43.015 INFO Your mission(您的任务) 33 The total time spent is(总耗时时间为): 24.3 秒 2022-08-12 20:15:43.015 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.
[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result [INFO] Job failed! Will not try get execute result. ============Result:================ TaskId:33 ExecId: exec_id018019linkis-cg-entrance172.18.192.103:9104LINKISCLI_hadoop_spark_0 User:hadoop Current job status:FAILED extraMsg: errDesc: 21304, Task is Failed,errorMsg: errCode: 12003 ,desc: 172.18.192.103:9101_0 Failed to async get EngineNode AMErrorException: errCode: 30002 ,desc: ServiceInstance(linkis-cg-engineconn, 172.18.192.103:16786) ticketID:543ec8fe-9406-446a-88f8-351d56e34d2c 初始
[INFO] JobStatus is not 'success'. Will not retrieve result-set. ############Execute Error!!!########
!/bin/bash
ulimit -c 0 export HADOOP_CONF_DIR="/etc/hadoop/conf" export HIVE_CONF_DIR="/etc/hive/conf" export JAVA_HOME="/usr/java/default/" export LOG_DIRS="/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/logs" export ECM_PORT="9102" export EUREKA_PREFER_IP="true" export USER="hadoop" export ECM_HOST="bda01node03-adm.oracle.cn" export ENGINECONN_ENVKEYS="" export TEMP_DIRS="/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/tmp" export HADOOP_HOME="/opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/lib/hadoop" export ECM_HOME="/opt/linkis/conf/" export UDF_JARS="" export PWD="/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c" export RANDOM_PORT="37767" export CLASSPATH="${PWD}/conf:/opt/linkis/conf:${PWD}/lib/*:${PWD}" ln -sf "/appcom/tmp/engineConnPublickDir/315bd4d0-f2c4-49a5-ae3c-835618c55fed/v000003/lib" "/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/lib" linkis_engineconn_errorcode=$? if [ $linkis_engineconn_errorcode -ne 0 ] then cat ${LOG_DIRS}/stderr exit $linkis_engineconn_errorcode fi ln -sf "/appcom/tmp/engineConnPublickDir/bf92d541-56e4-4cb1-aa7d-e9df95b3b1c1/v000002/conf" "/appcom/tmp/hadoop/20220812/spark/543ec8fe-9406-446a-88f8-351d56e34d2c/conf" linkis_engineconn_errorcode=$? if [ $linkis_engineconn_errorcode -ne 0 ] then cat ${LOG_DIRS}/stderr exit $linkis_engineconn_errorcode fi spark-submit --master yarn --deploy-mode client --name Linkis-EngineConn-Spark_LINKISCLI --jars ,${UDF_JARS} --conf spark.driver.extraJavaOptions=" -server -XX:+UseG1GC -XX:MaxPermSize=250m -XX:PermSize=128m -Xloggc:${LOG_DIRS}/gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -Dwds.linkis.server.conf=linkis-engineconn.properties -Dwds.linkis.gateway.url=http://172.18.192.103:9001 -Dlogging.file=log4j2.xml -DTICKET_ID=543ec8fe-9406-446a-88f8-351d56e34d2c -Djava.io.tmpdir=${TEMP_DIRS} -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=${RANDOM_PORT}" --conf spark.tispark.pd.addresses="pd0:2379" --conf spark.tispark.tidb.port="4000" --conf spark.tispark.tidb.user="root" --conf spark.tispark.tidb.addr="tidb" --driver-memory 1g --driver-class-path :${CLASSPATH} --driver-cores 1 --executor-memory 1g --executor-cores 1 --num-executors 1 --queue default --class org.apache.linkis.engineconn.launch.EngineConnServer 1> ${LOG_DIRS}/stdout 2>> ${LOG_DIRS}/stderr ${PWD}/lib/linkis-engineplugin-spark-1.1.1.jar --engineconn-conf wds.linkis.rm.instance=10 --engineconn-conf label.userCreator=hadoop-LINKISCLI --engineconn-conf ticketId=543ec8fe-9406-446a-88f8-351d56e34d2c --engineconn-conf wds.linkis.rm.yarnqueue.memory.max=300G --engineconn-conf spark.python.version=python2 --engineconn-conf label.engineType=spark-2.2.0.cloudera1 --engineconn-conf wds.linkis.rm.yarnqueue.instance.max=30 --engineconn-conf wds.linkis.rm.client.memory.max=20G --engineconn-conf wds.linkis.engineconn.max.free.time=1h --engineconn-conf wds.linkis.rm.client.core.max=10 --engineconn-conf wds.linkis.rm.yarnqueue.cores.max=150 --engineconn-conf user=hadoop --engineconn-conf wds.linkis.rm.yarnqueue=default --spring-conf eureka.client.serviceUrl.defaultZone=http://172.18.192.103:20303/eureka/ --spring-conf logging.config=classpath:log4j2.xml --spring-conf eureka.instance.prefer-ip-address=true --spring-conf spring.profiles.active=engineconn --spring-conf eureka.instance.instance-id=\${spring.cloud.client.ip-address}:\${spring.application.name}:\${server.port} --spring-conf server.port=16786 --spring-conf spring.application.name=linkis-cg-engineconn linkis_engineconn_errorcode=$? if [ $linkis_engineconn_errorcode -ne 0 ] then cat ${LOG_DIRS}/stderr exit $linkis_engineconn_errorcode fi