apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.3k stars 1.17k forks source link

[Bug] Ambari2.7.5+hdp3.1.5 failed to start hive #2594

Closed ruY9527 closed 2 years ago

ruY9527 commented 2 years ago

Search before asking

Linkis Component

linkis-cg-engineConnplugin

What happened + What you expected to happen

env: Ambari2.7.5 + hdp3.1.5 hadoop3.1.1,hive3.1.1,spark2, linkis1.1.2 + dss1.1.0 ERROR Job with execId-IDE_hadoop_hive_0 + subJobId : 39  execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: 172-18-11-224:9101_2 Failed  to async get EngineNode AMErrorException: errCode: 30002 ,desc: ServiceInstance(linkis-cg-engineconn, 172-18-11-224:44466) ticketID:4998c507-014c-45c3-97d4-32809e1b843e 初始化引擎失败,原因: ServiceInstance(linkis-cg-engineconn, 172-18-11-224:44466): log dir: /appcom/tmp/hadoop/20220804/hive/4998c507-014c-45c3-97d4-32809e1b843e/logs,SessionNotRunning: TezSession has already shutdown.  Application application_1659518236192_0031 failed 2 times due to AM Container for appattempt_1659518236192_0031_000002 exited with  exitCode: 1 log link hdp_logs20220804.zip

Relevent platform

Version

Reproduction script

show databases; selec

Anything else

can refer to the link https://github.com/apache/incubator-linkis/pull/541# 清风 from wechat group 4

Are you willing to submit a PR?

github-actions[bot] commented 2 years ago

:blush: Welcome to the Apache Linkis (incubating) community!! We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

WeChat Group:

image Mailing Lists: name description Subscribe Unsubscribe archive
dev@linkis.apache.org community activity information subscribe unsubscribe archive
MrFengqin commented 2 years ago
  1. 打包hive引擎时的版本号需要跟环境上的hive版本一致;
  2. 启动失败,出现上述问题使用yarn logs -applicationId application_1659518236192_0031查看yarnlog日志;
  3. 出现[ERROR] [main] |app.DAGAppMaster|: Error started DAGAppMaster java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org .apache.hadoop.conf.Configuration.set(Configuration.java:1358) 在 org.apache.hadoop.conf.Configuration.set(Configuration.java:1339) 在 org.apache.tez.common.TezUtilsInternal.addUserSpecifiedTezConfiguration(TezUtilsInternal .java:94) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2432) 错误 检查guava版本,guava版本没有问题检查hive-exec.jar包,这是hive引擎包里的hive-exec.jar版本与环境上hive-exec.jar版本不一致出现的问题,可以将环境上hive/lib下相对应的jar包copy到hive引擎中解决这个问题