IDEA-CCNL / Fengshenbang-LM

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系,成为中文AIGC和认知智能的基础设施。
Apache License 2.0
4.01k stars 375 forks source link

LINK : fatal error LNK1181: 无法打开输入文件“aio.lib” #309

Open candowu opened 1 year ago

candowu commented 1 year ago

pip install -e . failed

Using cached https://mirrors.aliyun.com/pypi/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (765 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [16 lines of output] test.c LINK : fatal error LNK1181: 无法打开输入文件“aio.lib” Traceback (most recent call last): File "", line 2, in File "", line 34, in File "C:\Users\candowu\AppData\Local\Temp\pip-install-zgtokznx\deepspeed_5b2d035f5a4c4576bd710073312fe09b\setup.py", line 156, in abort(f"Unable to pre-compile {op_name}") File "C:\Users\candowu\AppData\Local\Temp\pip-install-zgtokznx\deepspeed_5b2d035f5a4c4576bd710073312fe09b\setup.py", line 48, in abort assert False, msg AssertionError: Unable to pre-compile async_io [WARNING] Torch did not find cuda available, if cross-compiling or running with cpu only you can ignore this message. Adding compute capability for Pascal, Volta, and Turing (compute capabilities 6.0, 6.1, 6.2) DS_BUILD_OPS=1 [WARNING] async_io requires the dev libaio .so object and headers but these were not found. [WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. [WARNING] One can disable async_io with DS_BUILD_AIO=0 [ERROR] Unable to pre-compile async_io [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed

× Encountered error while generating package metadata. ╰─> See above for output.

note: This is an issue with the package mentioned above, not pip. hint: See above for details.

mjw3177109 commented 1 year ago

I also have this problem

John-jin commented 1 year ago

me too

DddJLin commented 1 year ago

me three

hahahonline commented 1 year ago

someone fixed?

GGGGGGXY commented 1 year ago

are you installing in windows?

DddJLin commented 1 year ago

Yes!

GAOXinyu @.***>于2023年5月22日 周一22:00写道:

are you installing in windows?

— Reply to this email directly, view it on GitHub https://github.com/IDEA-CCNL/Fengshenbang-LM/issues/309#issuecomment-1557273592, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALR4O4RC2UWMULBK3AZWL5DXHNWO3ANCNFSM6AAAAAAWESKOKU . You are receiving this because you commented.Message ID: @.***>

dongluyang commented 1 year ago

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

CCodeInspect commented 10 months ago

pip install -e . failed

Using cached https://mirrors.aliyun.com/pypi/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (765 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [16 lines of output] test.c LINK : fatal error LNK1181: 无法打开输入文件“aio.lib” Traceback (most recent call last): File "", line 2, in File "", line 34, in File "C:\Users\candowu\AppData\Local\Temp\pip-install-zgtokznx\deepspeed_5b2d035f5a4c4576bd710073312fe09b\setup.py", line 156, in abort(f"Unable to pre-compile {op_name}") File "C:\Users\candowu\AppData\Local\Temp\pip-install-zgtokznx\deepspeed_5b2d035f5a4c4576bd710073312fe09b\setup.py", line 48, in abort assert False, msg AssertionError: Unable to pre-compile async_io [WARNING] Torch did not find cuda available, if cross-compiling or running with cpu only you can ignore this message. Adding compute capability for Pascal, Volta, and Turing (compute capabilities 6.0, 6.1, 6.2) DS_BUILD_OPS=1 [WARNING] async_io requires the dev libaio .so object and headers but these were not found. [WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. [WARNING] One can disable async_io with DS_BUILD_AIO=0 [ERROR] Unable to pre-compile async_io [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed

× Encountered error while generating package metadata. ╰─> See above for output.

note: This is an issue with the package mentioned above, not pip. hint: See above for details.

i also meet it 1701493705794

CCodeInspect commented 10 months ago

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

i clone Deepspeed and use python setup.py bdist_wheel ,then give me the errors: 1701494378521

CCodeInspect commented 10 months ago

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

And i search a answer about how to solve :https://github.com/microsoft/DeepSpeed/issues/1769. And the issues advice me to use wsl, i wonder to know your steps about how to solve.Thanks dalao ~

fengzhi09 commented 9 months ago

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

please refer to this link https://www.toutiao.com/article/7271252191200248360/, i give a solution for resolving above problem in windows

i clone Deepspeed and use python setup.py bdist_wheel ,then give me the errors: 1701494378521 I met the problem before, after i run pip install libaio i got bellow err image image