lucidrains / performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch
MIT License
1.08k stars 141 forks source link

Difficult installing on Windows machine #34

Open rasin-tsukuba opened 3 years ago

rasin-tsukuba commented 3 years ago

The environment:

Windows 10 20H1,
python 3.8.5
pytorch 1.7.0
Cuda compilation tools, release 10.1, V10.1.243
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/1] C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin\nvcc -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\torch\csrc\api\include -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\TH -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\include" -Id:\ProgramData\Miniconda3\envs\pytorch\include -Id:\ProgramData\Miniconda3\envs\pytorch\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.26.28801\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.26.28801\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\cppwinrt" -c C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\fast_transformers\hashing\hash_cuda.cu -o C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\build\temp.win-amd64-3.8\Release\fast_transformers/hashing/hash_cuda.obj -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -arch=compute_50 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=hash_cuda -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: C:/Users/rains/AppData/Local/Temp/easy_install-fdtfkv90/pytorch-fast-transformers-0.3.0/build/temp.win-amd64-3.8/Release/fast_transformers/hashing/hash_cuda.obj
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin\nvcc -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\torch\csrc\api\include -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\TH -Id:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\include" -Id:\ProgramData\Miniconda3\envs\pytorch\include -Id:\ProgramData\Miniconda3\envs\pytorch\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.26.28801\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.26.28801\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\cppwinrt" -c C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\fast_transformers\hashing\hash_cuda.cu -o C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\build\temp.win-amd64-3.8\Release\fast_transformers/hashing/hash_cuda.obj -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -arch=compute_50 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=hash_cuda -D_GLIBCXX_USE_CXX11_ABI=0
d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\c10/util/ThreadLocalDebugInfo.h(12): warning: modifier is ignored on an enum specifier

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\ATen/core/boxing/impl/boxing.h(100): warning: integer conversion resulted in a change of sign

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\ATen/record_function.h(13): warning: modifier is ignored on an enum specifier

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\ATen/core/op_registration/op_whitelist.h(39): warning: integer conversion resulted in a change of sign

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\torch/csrc/jit/ir/ir.h(1347): error: member "torch::jit::ProfileOptionalOp::Kind" may not be initialized

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\torch/csrc/autograd/profiler.h(106): warning: modifier is ignored on an enum specifier

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\torch/csrc/autograd/profiler.h(138): warning: modifier is ignored on an enum specifier

d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include/torch/csrc/api/include\torch/nn/modules/transformerlayer.h(73): warning: extra ";" ignored

C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.26.28801/include\xutility(4109): error: function "torch::OrderedDict<Key, Value>::Item::operator=(const torch::OrderedDict<std::string, at::Tensor>::Item &) [with Key=std::string, Value=at::Tensor]" (declared implicitly) cannot be referenced -- it is a deleted function
          detected during:
            instantiation of "_OutIt std::_Move_unchecked1(_InIt, _InIt, _OutIt, std::false_type) [with _InIt=torch::OrderedDict<std::string, at::Tensor>::Item *, _OutIt=torch::OrderedDict<std::string, at::Tensor>::Item *]"
(4125): here
            instantiation of "_OutIt std::_Move_unchecked(_InIt, _InIt, _OutIt) [with _InIt=torch::OrderedDict<std::string, at::Tensor>::Item *, _OutIt=torch::OrderedDict<std::string, at::Tensor>::Item *]"
C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.26.28801/include\vector(1353): here
            instantiation of "std::vector<_Ty, _Alloc>::iterator std::vector<_Ty, _Alloc>::erase(std::vector<_Ty, _Alloc>::const_iterator) [with _Ty=torch::OrderedDict<std::string, at::Tensor>::Item, _Alloc=std::allocator<torch::OrderedDict<std::string, at::Tensor>::Item>]"
d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include\torch/csrc/api/include/torch/ordered_dict.h(419): here
            instantiation of "void torch::OrderedDict<Key, Value>::erase(const Key &) [with Key=std::string, Value=at::Tensor]"
d:/ProgramData/Miniconda3/envs/pytorch/lib/site-packages/torch/include/torch/csrc/api/include\torch/nn/modules/container/parameterdict.h(51): here

2 errors detected in the compilation of "C:/Users/rains/AppData/Local/Temp/tmpxft_00002f64_00000000-10_hash_cuda.cpp1.ii".
hash_cuda.cu
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 1516, in _run_ninja_build
    subprocess.run(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 152, in save_modules
    yield saved
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 193, in setup_context
    yield
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 254, in run_setup
    _execfile(setup_script, ns)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 43, in _execfile
    exec(code, globals, locals)
  File "C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\setup.py", line 209, in <module>
  File "C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\setup.py", line 182, in setup_package
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\__init__.py", line 153, in setup
    return distutils.core.setup(**attrs)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\core.py", line 148, in setup
    dist.run_commands()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\bdist_egg.py", line 167, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\bdist_egg.py", line 153, in call_command
    self.run_command(cmdname)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\install_lib.py", line 11, in run
    self.build()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\install_lib.py", line 107, in build
    self.run_command('build_ext')
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\build_ext.py", line 79, in run
    _build_ext.run(self)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 340, in run
    self.build_extensions()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 653, in build_extensions
    build_ext.build_extensions(self)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 449, in build_extensions
    self._build_extensions_serial()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 474, in _build_extensions_serial
    self.build_extension(ext)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\build_ext.py", line 196, in build_extension
    _build_ext.build_extension(self, ext)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 528, in build_extension
    objects = self.compiler.compile(sources,
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 626, in win_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 1233, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 1538, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "setup.py", line 3, in <module>
    setup(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\__init__.py", line 153, in setup
    return distutils.core.setup(**attrs)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\core.py", line 148, in setup
    dist.run_commands()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\install.py", line 67, in run
    self.do_egg_install()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\install.py", line 117, in do_egg_install
    cmd.run(show_deprecation=False)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 408, in run
    self.easy_install(spec, not self.no_deps)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 650, in easy_install
    return self.install_item(None, spec, tmpdir, deps, True)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 697, in install_item
    self.process_distribution(spec, dist, deps)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 741, in process_distribution
    distros = WorkingSet([]).resolve(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\pkg_resources\__init__.py", line 764, in resolve
    dist = best[req.key] = env.best_match(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\pkg_resources\__init__.py", line 1049, in best_match
    return self.obtain(req, installer)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\pkg_resources\__init__.py", line 1061, in obtain
    return installer(requirement)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 669, in easy_install
    return self.install_item(spec, dist.location, tmpdir, deps)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 695, in install_item
    dists = self.install_eggs(spec, download, tmpdir)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 880, in install_eggs
    return self.build_and_install(setup_script, setup_base)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 1150, in build_and_install
    self.run_setup(setup_script, setup_base, args)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\easy_install.py", line 1134, in run_setup
    run_setup(setup_script, args)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 257, in run_setup
    raise
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 193, in setup_context
    yield
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 164, in save_modules
    saved_exc.resume()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 139, in resume
    raise exc.with_traceback(self._tb)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 152, in save_modules
    yield saved
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 193, in setup_context
    yield
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 254, in run_setup
    _execfile(setup_script, ns)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\sandbox.py", line 43, in _execfile
    exec(code, globals, locals)
  File "C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\setup.py", line 209, in <module>
  File "C:\Users\rains\AppData\Local\Temp\easy_install-fdtfkv90\pytorch-fast-transformers-0.3.0\setup.py", line 182, in setup_package
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\__init__.py", line 153, in setup
    return distutils.core.setup(**attrs)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\core.py", line 148, in setup
    dist.run_commands()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\bdist_egg.py", line 167, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\bdist_egg.py", line 153, in call_command
    self.run_command(cmdname)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\install_lib.py", line 11, in run
    self.build()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\install_lib.py", line 107, in build
    self.run_command('build_ext')
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\dist.py", line 985, in run_command
    cmd_obj.run()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\build_ext.py", line 79, in run
    _build_ext.run(self)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 340, in run
    self.build_extensions()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 653, in build_extensions
    build_ext.build_extensions(self)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 449, in build_extensions
    self._build_extensions_serial()
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 474, in _build_extensions_serial
    self.build_extension(ext)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\setuptools\command\build_ext.py", line 196, in build_extension
    _build_ext.build_extension(self, ext)
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\distutils\command\build_ext.py", line 528, in build_extension
    objects = self.compiler.compile(sources,
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 626, in win_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 1233, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "d:\ProgramData\Miniconda3\envs\pytorch\lib\site-packages\torch\utils\cpp_extension.py", line 1538, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension