THUDM / ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
Apache License 2.0
40.03k stars 5.16k forks source link

[BUG/Help] <title>EOFError: EOF when reading a line #1367

Open luckytalk opened 11 months ago

luckytalk commented 11 months ago

Is there an existing issue for this?

Current Behavior

在docker中布署时,我试图使用cpu下的cli模式时报错: 用户:Traceback (most recent call last): File "/workspace/cli_demo.py", line 58, in main() File "/workspace/cli_demo.py", line 34, in main query = input("\n用户:") EOFError: EOF when reading a line

Expected Behavior

解决cpu模式的docker布署

Steps To Reproduce

1.在运行docker之前,首先安装了pytorch; 2.在Dockerfile中调用了cli_demo.py; 3.在pull_model.py中使用了CPU模式; 4.在cli_demo.py中使用了CPU模式

Environment

- OS:centos 7.0
- Python:3.10.3
- Transformers:4.27.1
- PyTorch:2.0
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :CUDA11.6

Anything else?

我试图实现在没有GPU的情况下,使用集群完成系统布署,测试一下集群的运算能力是否可以替代GPU。所以希望在DOCKER中布署CPU模式。