apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.3k stars 1.17k forks source link

[Question] sh ./bin/linkis-cli -engineType flink-1.12.2 -codeType sql -code "show tables" #2651

Closed waynecookie closed 2 years ago

waynecookie commented 2 years ago

Before asking

Your environment

Describe your questions

Q1. 在Linkis中部署Streamis后,执行任务报异常 1、报错如下: `=====Java Start Command===== exec /home/hadoop/apps/java/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hadoop/apps/dss/liniks/logs/linkis-cli -XX:ErrorFile=/home/hadoop/apps/dss/liniks/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC -classpath /home/hadoop/apps/dss/liniks/conf/linkis-cli:/home/hadoop/apps/dss/liniks/lib/linkis-computation-governance/linkis-client/linkis-cli/:/home/hadoop/apps/dss/liniks/lib/linkis-commons/public-module/:.:/home/hadoop/apps/java/lib/dt.jar:/home/hadoop/apps/java/lib/tools.jar:/home/hadoop/apps/java/jre/lib: -Dconf.root=/home/hadoop/apps/dss/liniks/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/home/hadoop/apps/dss/liniks/logs/linkis-cli -Dlog.file=linkis-client.hadoop.log.20220809144040914034870 org.apache.linkis.cli.application.LinkisClientApplication '-engineType flink-1.12.2 -codeType sql -code show tables' [INFO] LogFile path: /home/hadoop/apps/dss/liniks/logs/linkis-cli/linkis-client.hadoop.log.20220809144040914034870 [INFO] User does not provide usr-configuration file. Will use default config [INFO] user does not specify submit-user, will use current Linux user "hadoop" by default. [INFO] user does not specify proxy-user, will use current submit-user "hadoop" by default. [INFO] connecting to linkis gateway:http://127.0.0.1:9001 JobId:161 TaskId:161 ExecId:exec_id018011linkis-cg-entrancepnode3:9104LINKISCLI_hadoop_flink_1 [INFO] Job is successfully submitted!

2022-08-09 14:40:42.040 INFO Program is substituting variables for you 2022-08-09 14:40:43.040 INFO Variables substitution ended successfully 2022-08-09 14:40:43.040 WARN The code you submit will not be limited by the limit Job with jobId : LINKISCLI_hadoop_flink_1 and execID : LINKISCLI_hadoop_flink_1 submitted 2022-08-09 14:40:43.040 INFO You have submitted a new job, script code (after variable substitution) is ****SCRIPT CODE**** show tables ****SCRIPT CODE**** 2022-08-09 14:40:43.040 INFO Your job is accepted, jobID is LINKISCLI_hadoop_flink_1 and jobReqId is 161 in ServiceInstance(linkis-cg-entrance, pnode3:9104). Please wait it to be scheduled job is scheduled. 2022-08-09 14:40:43.040 INFO Your job is Scheduled. Please wait it to run. Your job is being scheduled by orchestrator. 2022-08-09 14:40:43.040 INFO job is running. 2022-08-09 14:40:43.040 INFO Your job is Running now. Please wait it to complete. 2022-08-09 14:40:43.040 INFO Job with jobGroupId : 161 and subJobId : 161 was submitted to Orchestrator. 2022-08-09 14:40:43.040 INFO Background is starting a new engine for you,execId astJob_1_codeExec_1 mark id is mark_1, it may take several seconds, please wait 2022-08-09 14:40:44.040 ERROR Job with execId-LINKISCLI_hadoop_flink_1 + subJobId : 161 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: pnode3:9101_1 Failed to async get EngineNode AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em ServiceInstance(linkis-cg-engineconnmanager, pnode3:9102) ,ip: pnode3 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: pnode3 ,port: 9104 ,serviceKind: linkis-cg-entrance

2022-08-09 14:40:44.040 INFO job is completed. 2022-08-09 14:40:44.040 INFO Task creation time(任务创建时间): 2022-08-09 14:40:42, Task scheduling time(任务调度时间): 2022-08-09 14:40:43, Task start time(任务开始时间): 2022-08-09 14:40:43, Mission end time(任务结束时间): 2022-08-09 14:40:44 2022-08-09 14:40:44.040 INFO Your mission(您的任务) 161 The total time spent is(总耗时时间为): 1.1 秒 2022-08-09 14:40:44.040 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.

[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result [INFO] Job failed! Will not try get execute result. ============Result:================ TaskId:161 ExecId: exec_id018011linkis-cg-entrancepnode3:9104LINKISCLI_hadoop_flink_1 User:hadoop Current job status:FAILED extraMsg: errDesc: 21304, Task is Failed,errorMsg: errCode: 12003 ,desc: pnode3:9101_1 Failed to async get EngineNode AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em ServiceInstance(linkis-cg-engineconnmanager, pnode3:9102) ,ip: pnode3 ,port: 9101 ,ser

[INFO] JobStatus is not 'success'. Will not retrieve result-set. ############Execute Error!!!######## `

Eureka service list

image

Some logs info or acctch file

github-actions[bot] commented 2 years ago

:blush: Welcome to the Apache Linkis (incubating) community!! We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

WeChat Group:

image Mailing Lists: name description Subscribe Unsubscribe archive
dev@linkis.apache.org community activity information subscribe unsubscribe archive
ruY9527 commented 2 years ago

hi,it is convenient to provide the error log files of the following services when an error occurs: linkis-cg-entrance linkis-cg-engineconnmanager linkis-cg-engineplugin

你好,方便提供下当时发生错误的时候,下列这些服务的错误日志: linkis-cg-entrance linkis-cg-engineconnmanager linkis-cg-engineplugin

waynecookie commented 2 years ago

[Uploading linkis-cg-engineconnmanager.log…]()

ruY9527 commented 2 years ago

Linkis log file linkis的log文件 linkis logs.zip

ruY9527 commented 2 years ago

see https://linkis.apache.org/zh-CN/docs/1.1.1/engine_usage/flink. Your log shows that you lack the relevant environment variable configuration. 你的log显示你缺少相关的环境变量配置 image