search

nusnlp / mlconvgec2018

Code and model files for the paper: "A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction" (AAAI-18).
GNU General Public License v3.0
185 stars 73 forks source link

Error in installing fairseq-py from setup.py #14

Closed vikaskaviya closed 5 years ago

vikaskaviya commented 5 years ago

I'm using pytorch 2.0 post 3 as the fairseq-py setup required and trying to install fairseq by given file in software directory, still having this issue ? I tried avialable solutions on google, most of them suggest installing some file, tried all of them still not able to solve this issue ?

vikas@unicorn:~/Desktop/mlconvgec2018/software/fairseq-py$ sudo python3 setup.py install running install running bdist_egg running egg_info writing fairseq.egg-info/PKG-INFO writing dependency_links to fairseq.egg-info/dependency_links.txt writing requirements to fairseq.egg-info/requires.txt writing top-level names to fairseq.egg-info/top_level.txt reading manifest file 'fairseq.egg-info/SOURCES.txt' writing manifest file 'fairseq.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py generating /tmp/tmp5v3uevsm/_temporal_convolution_tbc.c setting the current directory to '/tmp/tmp5v3uevsm' running build_ext building '_temporal_convolution_tbc' extension creating home creating home/vikas creating home/vikas/Desktop creating home/vikas/Desktop/mlconvgec2018 creating home/vikas/Desktop/mlconvgec2018/software creating home/vikas/Desktop/mlconvgec2018/software/fairseq-py creating home/vikas/Desktop/mlconvgec2018/software/fairseq-py/fairseq creating home/vikas/Desktop/mlconvgec2018/software/fairseq-py/fairseq/clib creating home/vikas/Desktop/mlconvgec2018/software/fairseq-py/fairseq/clib/temporal_convolution_tbc x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DWITH_CUDA -I/home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/include/python3.6m -c _temporal_convolution_tbc.c -o ./_temporal_convolution_tbc.o -std=c++11 cc1: warning: command line option ‘-std=c++11’ is valid for C++/ObjC++ but not for C In file included from /home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC/THC.h:4:0, from _temporal_convolution_tbc.c:493: /home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC/THCGeneral.h:9:10: fatal error: cuda.h: No such file or directory

include "cuda.h"

      ^~~~~~~~

compilation terminated. Traceback (most recent call last): File "/usr/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile extra_postargs) File "/usr/lib/python3.6/distutils/ccompiler.py", line 909, in spawn spawn(cmd, dry_run=self.dry_run) File "/usr/lib/python3.6/distutils/spawn.py", line 36, in spawn _spawn_posix(cmd, search_path, dry_run=dry_run) File "/usr/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix % (cmd, exit_status)) distutils.errors.DistutilsExecError: command 'x86_64-linux-gnu-gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vikas/.local/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build dist.run_command('build_ext') File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command cmd_obj.run() File "/usr/lib/python3/dist-packages/setuptools/command/build_ext.py", line 78, in run _build_ext.run(self) File "/usr/lib/python3.6/distutils/command/build_ext.py", line 339, in run self.build_extensions() File "/usr/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions self._build_extensions_serial() File "/usr/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial self.build_extension(ext) File "/usr/lib/python3/dist-packages/setuptools/command/build_ext.py", line 199, in build_extension _build_ext.build_extension(self, ext) File "/usr/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension depends=ext.depends) File "/usr/lib/python3.6/distutils/ccompiler.py", line 574, in compile self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts) File "/usr/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile raise CompileError(msg) distutils.errors.CompileError: command 'x86_64-linux-gnu-gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "setup.py", line 69, in 'build_py': build_py_hook, File "/usr/lib/python3/dist-packages/setuptools/init.py", line 129, in setup return distutils.core.setup(attrs) File "/usr/lib/python3.6/distutils/core.py", line 148, in setup dist.run_commands() File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands self.run_command(cmd) File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command cmd_obj.run() File "/usr/lib/python3/dist-packages/setuptools/command/install.py", line 67, in run self.do_egg_install() File "/usr/lib/python3/dist-packages/setuptools/command/install.py", line 109, in do_egg_install self.run_command('bdist_egg') File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command self.distribution.run_command(command) File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command cmd_obj.run() File "/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py", line 172, in run cmd = self.call_command('install_lib', warn_dir=0) File "/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py", line 158, in call_command self.run_command(cmdname) File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command self.distribution.run_command(command) File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command cmd_obj.run() File "/usr/lib/python3/dist-packages/setuptools/command/install_lib.py", line 24, in run self.build() File "/usr/lib/python3.6/distutils/command/install_lib.py", line 107, in build self.run_command('build_py') File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command self.distribution.run_command(command) File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command cmd_obj.run() File "setup.py", line 49, in run conv_tbc.build() File "/home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 164, in build _build_extension(ffi, cffi_wrapper_name, target_dir, verbose) File "/home/vikas/.local/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 100, in _build_extension ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname) File "/home/vikas/.local/lib/python3.6/site-packages/cffi/api.py", line 697, in compile compiler_verbose=verbose, debug=debug, kwds) File "/home/vikas/.local/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile compiler_verbose, debug) File "/home/vikas/.local/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile outputfilename = _build(tmpdir, ext, compiler_verbose, debug) File "/home/vikas/.local/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build raise VerificationError('%s: %s' % (e.class.name, e)) cffi.error.VerificationError: CompileError: command 'x86_64-linux-gnu-gcc' failed with exit status 1

shamilcm commented 5 years ago

The version of Fairseq that we used works on NVIDIA GPU machine with CUDA already set up. Check PATH and LD_LIBRARY_PATH environment variables point to your CUDA installation correctly.

Did you also install Pytorch with GPU support compiled from source?