[Question] spark任务提交到yarn，一直是Running状态

[lishengming6]

Before asking

• [X] I have read the How to ask for help (我已阅读如何寻求帮助指引文档).

Your environment

• Linkis version used: 1.1.2
• Environment name and version:
  • cdh-5.14.2
  • hdp-3.1.5
  • hive-2.1.1
  • spark-3.2.1
  • scala-2.12.2
  • jdk 1.8.0_121
  • ....

Describe your questions

view组件执行sql，spark引擎提交任务到yarn，yarn任务一直在running，前台数据是返回的 疑问：spark引擎的任务到yarn是常驻的吗？我kill掉引擎就发现yarn任务是finished的，有什么方法可以让spark提交到yarn任务执行完状态变成finished吗？

Eureka service list

eg:

Some logs info or acctch file

linkis-xxx.log:

<!--日志文字贴到这里-->

log file:

linkis-xxx.log

[github-actions[bot]]

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant	WeChat Public Account

Mailing Lists

Name	Description	Subscribe	Unsubscribe	Archive
dev@linkis.apache.org	community activity information	subscribe	unsubscribe	archive

[casionone]

Check whether the yarn service is ok You can run the spark-sql command on the machine to see if the task submitted to yarn is normal.

[peacewong]

Hello, this is because the Spark engine is reused, so spark is released when idle. You can add the label executeOnce so that the Spark session will exit after executing the task.

[lishengming6]

Is linkis 1.3.1 supported? And Where can I add the label？