apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.3k stars 1.17k forks source link

[Question]The linkis-cli-sqoop command execute error #4421

Closed luckyhuke closed 1 year ago

luckyhuke commented 1 year ago

Before asking

Your environment

Describe your questions

按照sqoop引擎使用文档进行配置后运行linkis-cli-sqoop报错:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class at org.apache.linkis.engineconn.launch.EngineConnServer$.(EngineConnServer.scala:55) at org.apache.linkis.engineconn.launch.EngineConnServer$.(EngineConnServer.scala) at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) Caused by: java.lang.ClassNotFoundException: org.apache.linkis.common.utils.Logging$class at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more

Eureka service list

image

Some logs info or acctch file

linkis-cg-engineconnmanager.log:

2023-03-28 19:05:13.663 [INFO ] [qtp1377456236-26 ] o.a.l.e.s.s.i.DefaultEngineConnListService (66) [addEngineConn] - add engineConn null to engineConnMap 2023-03-28 19:05:13.666 [INFO ] [qtp1377456236-26 ] o.a.l.e.l.l.LinuxProcessEngineConnLaunch (186) [getCommandArgs] - EUREKA_PREFER_IP: false 2023-03-28 19:05:13.668 [INFO ] [qtp1377456236-26 ] o.a.l.e.c.l.ShellProcessEngineCommandExec (49) [execute] - Invoke subProcess, base dir /ddhome/bin/appcom/tmp/hadoop/20230328/sqoop/d4624493-58cc-469e-a5d2-88350d3945de cmd is: sudo su - hadoop -c sh /ddhome/bin/appcom/tmp/hadoop/20230328/sqoop/d4624493-58cc-469e-a5d2-88350d3945de/engineConnExec.sh 2023-03-28 19:05:13.670 [INFO ] [EngineConn-Manager-Thread-4 ] o.a.l.e.s.s.i.LinuxProcessEngineConnLaunchService (100) [$anonfun$launchEngineConn$2] - wait engineConn ServiceInstance(linkis-cg-engineconn, ddavb:42929) start 2023-03-28 19:05:14.163 [INFO ] [EngineConn-Manager-Thread-5 ] o.a.l.e.s.s.i.LinuxProcessEngineConnLaunchService (129) [$anonfun$processMonitorThread$2] - engine d4624493-58cc-469e-a5d2-88350d3945de process exit 2023-03-28 19:05:14.164 [INFO ] [EngineConn-Manager-Thread-5 ] o.a.l.e.s.s.i.DefaultEngineConnListService (151) [onEvent] - Deal event EngineConnStatusChangeEvent(d4624493-58cc-469e-a5d2-88350d3945de,ShuttingDown) 2023-03-28 19:05:14.164 [INFO ] [EngineConn-Manager-Thread-5 ] o.a.l.e.s.s.i.DefaultEngineConnListService (145) [updateEngineConnStatus] - from engineConnMap to remove engineconn ticketId d4624493-58cc-469e-a5d2-88350d3945de 2023-03-28 19:05:14.164 [INFO ] [EngineConn-Manager-Thread-5 ] o.a.l.e.s.s.i.DefaultEngineConnListService (84) [killEngineConn] - engineconn ServiceInstance(linkis-cg-engineconn, ddavb:42929) was closed. 2023-03-28 19:05:14.276 [WARN ] [EngineConn-Manager-Thread-4 ] o.a.l.e.s.s.i.LinuxProcessEngineConnLaunchService (88) [$anonfun$waitEngineConnStart$3] - Failed to init ServiceInstance(linkis-cg-engineconn, ddavb:42929), status shutting down, canRetry false, logPath /ddhome/bin/appcom/tmp/hadoop/20230328/sqoop/d4624493-58cc-469e-a5d2-88350d3945de/logs org.apache.linkis.ecm.server.exception.ECMErrorException: errCode: 11102 ,desc: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class at org.apache.linkis.engineconn.launch.EngineConnServer$.(EngineConnServer.scala:55) at org.apache.linkis.engineconn.launch.EngineConnServer$.(EngineConnServer.scala) at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) Caused by: java.lang.ClassNotFoundException: org.apache.linkis.common.utils.Logging$class at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more ,ip: ddavb ,port: 9102 ,serviceKind: linkis-cg-engineconnmanager at org.apache.linkis.ecm.server.service.impl.ProcessEngineConnLaunchService.processMonitorThread(ProcessEngineConnLaunchService.scala:158) ~[linkis-engineconn-manager-server-1.3.1.jar:1.3.1] at org.apache.linkis.ecm.server.service.impl.ProcessEngineConnLaunchService.$anonfun$waitEngineConnStart$1(ProcessEngineConnLaunchService.scala:65) ~[linkis-engineconn-manager-server-1.3.1.jar:1.3.1] at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.10.jar:?] at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:47) ~[linkis-common-1.3.1.jar:1.3.1] at org.apache.linkis.ecm.server.service.impl.ProcessEngineConnLaunchService.waitEngineConnStart(ProcessEngineConnLaunchService.scala:66) ~[linkis-engineconn-manager-server-1.3.1.jar:1.3.1] at org.apache.linkis.ecm.server.service.impl.AbstractEngineConnLaunchService.$anonfun$launchEngineConn$2(AbstractEngineConnLaunchService.scala:101) ~[linkis-engineconn-manager-server-1.3.1.jar:1.3.1] at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.10.jar:?] at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659) ~[scala-library-2.12.10.jar:?] at scala.util.Success.$anonfun$map$1(Try.scala:255) ~[scala-library-2.12.10.jar:?] at scala.util.Success.map(Try.scala:213) ~[scala-library-2.12.10.jar:?] at scala.concurrent.Future.$anonfun$map$1(Future.scala:292) ~[scala-library-2.12.10.jar:?] at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33) ~[scala-library-2.12.10.jar:?] at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33) ~[scala-library-2.12.10.jar:?] at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64) ~[scala-library-2.12.10.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_171] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_171]

log file:

github-actions[bot] commented 1 year ago

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
dev@linkis.apache.org community activity information subscribe unsubscribe archive
aiceflower commented 1 year ago

Check whether the directory of /ddhome/bin/appcom/tmp/hadoop/20230328/sqoop/d4624493-58cc-469e-a5d2-88350d3945de/logs exists or the user has read and write permission for the directory If the verification succeeds, check the contents of the file /ddhome/bin/appcom/tmp/hadoop/20230328/sqoop/d4624493-58cc-469e-a5d2-88350d3945de/logs/stdout to confirm the error information

casionone commented 1 year ago

I have not replied for a long time to close first, if necessary, you can re-open.