search

THUDM / ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
Apache License 2.0
40.47k stars 5.19k forks source link

服务器有多个程序占用GPU，占用率达到90%以上，导致推理不报错但长时间没反应 #1390

Open nvliajia opened 1 year ago

nvliajia commented 1 year ago

Is there an existing issue for this?

Current Behavior

服务器有多个程序占用GPU，占用率达到90%以上，导致推理不报错但长时间没反应

Expected Behavior

服务器有多个程序占用GPU，占用率达到90%以上，导致推理不报错但长时间没反应，如何解决这种问题

Steps To Reproduce

centos 7 python3.9

Environment

- OS:centos 7
- Python:python3.9
- Transformers:4.26.1
- PyTorch:1.2
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :True

Anything else?

No response