glample / fastBPE

Fast BPE
MIT License
656 stars 96 forks source link

python setup.py install failure #27

Open sergeman opened 5 years ago

sergeman commented 5 years ago

I am installing into Docker image using Ubuntu 18.04. Installation of Python package install needs fastBPE/fastBPE.cpp See below:

~/fastBPE# python setup.py install
/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'long_description_content_type'
  warnings.warn(msg)
running install
running bdist_egg
running egg_info
writing fastBPE.egg-info/PKG-INFO
writing top-level names to fastBPE.egg-info/top_level.txt
writing dependency_links to fastBPE.egg-info/dependency_links.txt
package init file 'fastBPE/__init__.py' not found (or not a regular file)
reading manifest file 'fastBPE.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'fastBPE.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
building 'fastBPE' extension
x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fdebug-prefix-map=/build/python2.7-_wncS2/python2.7-2.7.15=. -fstack-protector-strong -Wformat -Werror=format-security -fPIC -I/usr/include/python2.7 -c fastBPE/fastBPE.cpp -o build/temp.linux-x86_64-2.7/fastBPE/fastBPE.o -std=c++11 -Ofast -pthread
x86_64-linux-gnu-gcc: error: fastBPE/fastBPE.cpp: No such file or directory
x86_64-linux-gnu-gcc: fatal error: no input files
compilation terminated.
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
andrew-sn commented 5 years ago

I am installing into Docker image using Ubuntu 18.04. Installation of Python package install needs fastBPE/fastBPE.cpp See below:

~/fastBPE# python setup.py install
/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'long_description_content_type'
  warnings.warn(msg)
running install
running bdist_egg
running egg_info
writing fastBPE.egg-info/PKG-INFO
writing top-level names to fastBPE.egg-info/top_level.txt
writing dependency_links to fastBPE.egg-info/dependency_links.txt
package init file 'fastBPE/__init__.py' not found (or not a regular file)
reading manifest file 'fastBPE.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'fastBPE.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
building 'fastBPE' extension
x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fdebug-prefix-map=/build/python2.7-_wncS2/python2.7-2.7.15=. -fstack-protector-strong -Wformat -Werror=format-security -fPIC -I/usr/include/python2.7 -c fastBPE/fastBPE.cpp -o build/temp.linux-x86_64-2.7/fastBPE/fastBPE.o -std=c++11 -Ofast -pthread
x86_64-linux-gnu-gcc: error: fastBPE/fastBPE.cpp: No such file or directory
x86_64-linux-gnu-gcc: fatal error: no input files
compilation terminated.
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

In setup.py, if the program can't import Cython, it will look for fastBPE.cpp, which is the bug; so, first pip install Cython, then python setup.py install; it works on my Ubuntu;

bentona commented 5 years ago

Worked for me, thank you!

AaronZhangL commented 5 years ago

It worked for me, tks!

HoiBunCa commented 4 years ago

please, help me!!! i install fastBPE in win10 this is error: C:\Users\dinhv\Desktop\fastBPE-master>python setup.py install Compiling fastBPE/fastBPE.pyx because it changed. [1/1] Cythonizing fastBPE/fastBPE.pyx running install running bdist_egg running egg_info creating fastBPE.egg-info writing fastBPE.egg-info\PKG-INFO writing dependency_links to fastBPE.egg-info\dependency_links.txt writing top-level names to fastBPE.egg-info\top_level.txt writing manifest file 'fastBPE.egg-info\SOURCES.txt' package init file 'fastBPE__init__.py' not found (or not a regular file) reading manifest file 'fastBPE.egg-info\SOURCES.txt' reading manifest template 'MANIFEST.in' writing manifest file 'fastBPE.egg-info\SOURCES.txt' installing library code to build\bdist.win-amd64\egg running install_lib running build_py running build_ext building 'fastBPE' extension creating build creating build\temp.win-amd64-3.7 creating build\temp.win-amd64-3.7\Release creating build\temp.win-amd64-3.7\Release\fastBPE C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.25.28610\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -IfastBPE -IC:\Users\dinhv\AppData\Local\Programs\Python\Python37\include -IC:\Users\dinhv\AppData\Local\Programs\Python\Python37\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.25.28610\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.25.28610\include" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\cppwinrt" /EHsc /TpfastBPE/fastBPE.cpp /Fobuild\temp.win-amd64-3.7\Release\fastBPE/fastBPE.obj -std=c++11 -Ofast -pthread cl : Command line warning D9025 : overriding '/Os' with '/Ot' cl : Command line warning D9002 : ignoring unknown option '-std=c++11' cl : Command line warning D9002 : ignoring unknown option '-Of' cl : Command line warning D9002 : ignoring unknown option '-Oa' cl : Command line warning D9002 : ignoring unknown option '-pthread' fastBPE.cpp C:\Users\dinhv\Desktop\fastBPE-master\fastBPE\fastBPE.hpp(15): fatal error C1083: Cannot open include file: 'sys/mman.h': No such file or directory error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.25.28610\bin\HostX86\x64\cl.exe' failed with exit status 2

Desperado721 commented 3 years ago

works for me, thanks, dude