run LightGBM with multithreading on rainbond will cause LightGBM to hang

goodrain / rainbond

No need to know Kubernetes' cloud native application management platform | 不用懂 Kubernetes 的云原生应用管理平台

https://www.rainbond.com

GNU Lesser General Public License v3.0

5.06k stars 790 forks source link

run LightGBM with multithreading on rainbond will cause LightGBM to hang #1976

Closed CCYYGO closed 1 month ago

CCYYGO commented 1 month ago

Describe the bug I finished the ci/cd pipeline and run the programs on Rainbond, I find the program be stucked.I try to solve this problem and find the #issue on LightGBM FAQ. I try to set nthread=1, it solve the problem that program not be stucked, but it run slowly. So, i want to know that how i can using multithreading LightGBM on Rainbond

ZhangSetSail commented 1 month ago

尝试一下调整 CPU、内存资源，调整 nthread 参数，设置为适合的线程数（比如与 CPU 核心数相匹配）

Issues-translate-bot commented 1 month ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Try adjusting CPU and memory resources, adjusting nthread parameters, and setting it to a suitable number of threads (for example, matching the number of CPU cores)

CCYYGO commented 1 month ago

谢谢，我的问题被解决了。我还有一写额外的疑问：

是否只要是小于等于线程数即可？还是说需要与核心数相等？
其背后的原理是否和 rainbond 启用多线程的方式相关？还是说与编译方式有关？我在本地的docker容器直接跑源码是没有遇见这个问题的

Issues-translate-bot commented 1 month ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Thanks, my problem is solved. I have one additional question:

Is it enough to be less than or equal to the number of threads? Or does it need to be equal to the number of cores?
Is the principle behind this related to the way rainbond enables multi-threading? Or is it related to the compilation method? I ran the source code directly in the local docker container and did not encounter this problem.

ZhangSetSail commented 1 month ago

第一个问题，小于等于都可以，等于的话是最佳配置。第二个问题，还不能确定，你这个项目有自己的 dockerfile 吗，尝试用自己的 dockerfile 构建看看是否会出现这个问题。

Issues-translate-bot commented 1 month ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

The first question is, it can be less than or equal to. If it is equal to, it is the best configuration. The second question is not sure yet. Does your project have its own dockerfile? Try building it with your own dockerfile to see if this problem occurs.

ZhangSetSail commented 1 month ago

还有问题吗，没问题我将关闭这个issue了

Issues-translate-bot commented 1 month ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Do you still have any questions? No problem. I will close this issue.

CCYYGO commented 1 month ago

好的，暂时没什么问题，谢谢

Closed #1976 as completed.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>