[Question] Linkis1.4.0版本多个ECM节点无法进行负载

[wzx-ang]

Before asking

• [X] I have read the How to ask for help (我已阅读如何寻求帮助指引文档).

Your environment

• Linkis version used: 1.4.0
• Environment name and version:
  • cdh-6.3.2
  • hive-2.1.1
  • spark-3.2.1
  • scala-2.11
  • jdk 1.8.0_121

Describe your questions

我是分布式服务部署，有两个ecm节点，但是只会有随机一个ecm节点工作，即使达到任务最大并发数20个后报错，另外一个ecm节点也不会参与工作创建引擎。 并且在重启时如果只启动一个ecm节点，任务提交会报错，启动两个节点后可提交任务，但只有一个节点工作。

Eureka service list

Some logs info or acctch file

运行中的ECM节点logs目录下会有一个文件：linkis-cg-engineconnmanager-kill-2024-05.log 文件内容： 2024-05-29 09:31:52 Starting to kill parent process 21000 2024-05-29 09:31:57 Finished to kill parent process 21000 2024-05-29 09:31:57 Finished killing process and its ecmPid 23965 sub-process 21000 2024-05-29 09:32:00 Finished to kill parent process 21000 2024-05-29 09:32:00 Finished killing process and its ecmPid 23965 sub-process 21000

2024-05-29 09:47:50 Starting to kill parent process 25484

2024-05-29 09:47:52 Starting to kill parent process 25484 2024-05-29 09:47:57 Finished to kill parent process 25484 2024-05-29 09:47:57 Finished killing process and its ecmPid 23965 sub-process 25484

2024-05-29 09:47:58 Starting to kill parent process 25128 2024-05-29 09:48:00 Finished to kill parent process 25484 2024-05-29 09:48:00 Finished killing process and its ecmPid 23965 sub-process 25484

2024-05-29 09:48:00 Starting to kill parent process 25128 2024-05-29 09:48:05 Finished to kill parent process 25128 2024-05-29 09:48:05 Finished killing process and its ecmPid 23965 sub-process 25128 2024-05-29 09:48:08 Finished to kill parent process 25128 2024-05-29 09:48:08 Finished killing process and its ecmPid 23965 sub-process 25128

2024-05-29 09:49:50 Starting to kill parent process 26363

2024-05-29 09:49:52 Starting to kill parent process 26363 2024-05-29 09:49:57 Finished to kill parent process 26363 2024-05-29 09:49:57 Finished killing process and its ecmPid 23965 sub-process 26363 2024-05-29 09:50:00 Finished to kill parent process 26363 2024-05-29 09:50:00 Finished killing process and its ecmPid 23965 sub-process 26363

[github-actions[bot]]

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant	WeChat Public Account

Mailing Lists

Name	Description	Subscribe	Unsubscribe	Archive
dev@linkis.apache.org	community activity information	subscribe	unsubscribe	archive

[peacewong]

Hello, you can upgrade to 1.5.0 or merge this PR：https://github.com/apache/linkis/pull/4915