glample / fastBPE

Fast BPE
MIT License
653 stars 97 forks source link

Error occurred when install fastBPE with pip3 on Windows #54

Open hsiang-lee opened 2 years ago

hsiang-lee commented 2 years ago

I try to install fastBPE with "pip3 install fastBPE", errors occurred. Here is the logs:

Collecting fastBPE Using cached fastBPE-0.1.0.tar.gz (35 kB) Preparing metadata (setup.py) ... done Building wheels for collected packages: fastBPE Building wheel for fastBPE (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [19 lines of output] running bdist_wheel running build running build_py package init file 'fastBPE__init__.py' not found (or not a regular file) running build_ext building 'fastBPE' extension creating build creating build\temp.win-amd64-3.9 creating build\temp.win-amd64-3.9\Release creating build\temp.win-amd64-3.9\Release\fastBPE C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -IC:\Users\leehsiang\AppData\Local\Programs\Python\Python39\include -IC:\Users\leehsiang\AppData\Local\Programs\Python\Python39\include -IC:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\ATLMFC\include -IC:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\include -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\shared -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt /EHsc /TpfastBPE/fastBPE.cpp /Fobuild\temp.win-amd64-3.9\Release\fastBPE/fastBPE.obj -std=c++11 -Ofast -pthread cl: 命令行 warning D9025 :正在重写“/Os”(用“/Ot”) cl: 命令行 warning D9002 :忽略未知选项“-std=c++11” cl: 命令行 warning D9002 :忽略未知选项“-Of” cl: 命令行 warning D9002 :忽略未知选项“-Oa” cl: 命令行 warning D9002 :忽略未知选项“-pthread” fastBPE.cpp C:\Users\leehsiang\AppData\Local\Temp\pip-install-kj3mgi5k\fastbpe_a8c8008d8dc444068a0ab7d1b2517139\fastBPE\fastBPE.hpp(15): fatal error C1083: 无法打开包括文件: “sys/mman.h”: No such file or directory error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe' failed with exit code 2 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for fastBPE Running setup.py clean for fastBPE Failed to build fastBPE WARNING: Ignoring invalid distribution -umpy (c:\users\leehsiang\appdata\local\programs\python\python39\lib\site-packages) WARNING: Ignoring invalid distribution - (c:\users\leehsiang\appdata\local\programs\python\python39\lib\site-packages) Installing collected packages: fastBPE Running setup.py install for fastBPE ... error error: subprocess-exited-with-error

× Running setup.py install for fastBPE did not run successfully. │ exit code: 1 ╰─> [19 lines of output] running install running build running build_py package init file 'fastBPE__init__.py' not found (or not a regular file) running build_ext building 'fastBPE' extension creating build creating build\temp.win-amd64-3.9 creating build\temp.win-amd64-3.9\Release creating build\temp.win-amd64-3.9\Release\fastBPE C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -IC:\Users\leehsiang\AppData\Local\Programs\Python\Python39\include -IC:\Users\leehsiang\AppData\Local\Programs\Python\Python39\include -IC:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\ATLMFC\include -IC:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\include -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\shared -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt -IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt /EHsc /TpfastBPE/fastBPE.cpp /Fobuild\temp.win-amd64-3.9\Release\fastBPE/fastBPE.obj -std=c++11 -Ofast -pthread cl: 命令行 warning D9025 :正在重写“/Os”(用“/Ot”) cl: 命令行 warning D9002 :忽略未知选项“-std=c++11” cl: 命令行 warning D9002 :忽略未知选项“-Of” cl: 命令行 warning D9002 :忽略未知选项“-Oa” cl: 命令行 warning D9002 :忽略未知选项“-pthread” fastBPE.cpp C:\Users\leehsiang\AppData\Local\Temp\pip-install-kj3mgi5k\fastbpe_a8c8008d8dc444068a0ab7d1b2517139\fastBPE\fastBPE.hpp(15): fatal error C1083: 无法打开包括文件: “sys/mman.h”: No such file or directory error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe' failed with exit code 2 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: legacy-install-failure

× Encountered error while trying to install package. ╰─> fastBPE

Could anyone help me?

calibretaliation commented 2 years ago

We are headaching with the same issue here, you can take a look, may it help. https://github.com/pytorch/fairseq/issues/1224