baichuan-inc / Baichuan-7B

A large-scale 7B pretraining language model developed by BaiChuan-Inc.
https://huggingface.co/baichuan-inc/baichuan-7B
Apache License 2.0
5.67k stars 506 forks source link

[Question] 安装依赖时终端报错(deepspeed) #146

Open duolaBmeng673 opened 3 months ago

duolaBmeng673 commented 3 months ago

Required prerequisites

Questions

在终端安装依赖时首先报错显示没有安装torch,成功安装torch==2.0.0之后再次pip install -r requirements,结果终端报错显示 (Baichuan-7B) D:\pythonProject\Baichuan\Baichuan-7B>pip install -r requirements.txt Collecting deepspeed==0.9.2 (from -r requirements.txt (line 1)) Using cached deepspeed-0.9.2.tar.gz (779 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [15 lines of output] test.c LINK : fatal error LNK1181: 无法打开输入文件“aio.lib” Traceback (most recent call last): File "", line 2, in File "", line 34, in File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 162, in abort(f"Unable to pre-compile {op_name}") File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 51, in abort assert False, msg AssertionError: Unable to pre-compile async_io DS_BUILD_OPS=1 [WARNING] async_io requires the dev libaio .so object and headers but these were not found. [WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. [WARNING] One can disable async_io with DS_BUILD_AIO=0 [ERROR] Unable to pre-compile async_io [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed

× Encountered error while generating package metadata. ╰─> See above for output.

note: This is an issue with the package mentioned above, not pip. hint: See above for details. 经查阅后得知libaio为linux系统的包,有没有方法可以再win11上解决这个问题?

Checklist