Closed dani-lbnl closed 4 years ago
This fails: pip install -r requirements.txt Error: ...... Building wheel for numcodecs (setup.py) ... error ERROR: Command errored out with exit status 1: command: /global/homes/u/ushizima/.conda/envs/fibercam/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"'; file='"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-6vsxjlzl cwd: /tmp/pip-install-kpz07wl0/numcodecs/ Complete output (132 lines): [numcodecs] setting up Blosc extension [numcodecs] compiling Blosc extension with SSE2 support [numcodecs] compiling Blosc extension with AVX2 support [numcodecs] setting up Zstandard extension [numcodecs] setting up LZ4 extension [numcodecs] setting up compat extension [numcodecs] setting up vlen extension running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.7 creating build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/zlib.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/version.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/registry.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/quantize.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/pickles.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/packbits.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/msgpacks.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/lzma.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/json.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/gzip.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/fixedscaleoffset.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/delta.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/compat.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/checksum32.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/categorize.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/bz2.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/base64.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/astype.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/abc.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/init.py -> build/lib.linux-x86_64-3.7/numcodecs creating build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_zstd.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_zlib.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_utf8.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_bytes.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_array.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_registry.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_quantize.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_pickles.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_packbits.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_msgpacks.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_lzma.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_lz4.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_json.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_gzip.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_fixedscaleoffset.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_delta.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_compat.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_checksum32.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_categorize.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_bz2.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_blosc.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_base64.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_astype.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/common.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/init.py -> build/lib.linux-x86_64-3.7/numcodecs/tests running build_ext building 'numcodecs.blosc' extension creating build/temp.linux-x86_64-3.7 creating build/temp.linux-x86_64-3.7/numcodecs gcc -pthread -B /global/homes/u/ushizima/.conda/envs/fibercam/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_LZ4=1 -DHAVE_SNAPPY=1 -DHAVE_ZLIB=1 -DHAVE_ZSTD=1 -Ic-blosc/blosc -I/global/homes/u/ushizima/.conda/envs/fibercam/include/python3.7m -c numcodecs/blosc.c -o build/temp.linux-x86_64-3.7/numcodecs/blosc.o -msse2 -mavx2 -DSHUFFLE_SSE2_ENABLED -DSHUFFLE_AVX2_ENABLED numcodecs/blosc.c:705:10: fatal error: blosc.h: No such file or directory
^~~~~~~~~
compilation terminated. [numcodecs] command 'gcc' failed with exit status 1 Traceback (most recent call last): File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/unixccompiler.py", line 118, in _compile extra_postargs) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/ccompiler.py", line 910, in spawn spawn(cmd, dry_run=self.dry_run) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/spawn.py", line 36, in spawn _spawn_posix(cmd, search_path, dry_run=dry_run) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/spawn.py", line 159, in _spawn_posix % (cmd, exit_status)) distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 276, in build_extension build_ext.build_extension(self, ext) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build_ext.py", line 534, in build_extension depends=ext.depends) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/ccompiler.py", line 574, in compile self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts) File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/unixccompiler.py", line 120, in _compile raise CompileError(msg) distutils.errors.CompileError: command 'gcc' failed with exit status 1
During handling of the above exception, another exception occurred:
ERROR: Failed building wheel for numcodecs Running setup.py clean for numcodecs Building wheel for simpervisor (setup.py) ... done Created wheel for simpervisor: filename=simpervisor-0.3-py3-none-any.whl size=5197 sha256=0837a2c0bc61de7ec1bd86193e3a1620a0532408c76416b88492fe1c9d17ecd3 Stored in directory: /global/u1/u/ushizima/.cache/pip/wheels/6d/02/72/27a10faccec8d314aa88ac6c099e11ab704497beaaf26a24f9 Building wheel for pandocfilters (setup.py) ... done Created wheel for pandocfilters: filename=pandocfilters-1.4.2-py3-none-any.whl size=7855 sha256=e46a320a369ab2a48aac425c26bd5398cc22c9970eb904cf2d273d036e2821e5 Stored in directory: /global/u1/u/ushizima/.cache/pip/wheels/63/99/01/9fe785b86d1e091a6b2a61e06ddb3d8eb1bc9acae5933d4740 Building wheel for pyrsistent (setup.py) ... done Created wheel for pyrsistent: filename=pyrsistent-0.16.0-cp37-cp37m-linux_x86_64.whl size=114345 sha256=366b5194043aaa1504e4a724abbf5b0411ea5b7a6130ae2b0de6a7480764a61d Stored in directory: /global/u1/u/ushizima/.cache/pip/wheels/22/52/11/f0920f95c23ed7d2d0b05f2b7b2f4509e87a20cfe8ea43d987 Successfully built zarr dask-labextension asciitree simpervisor pandocfilters pyrsistent Failed to build numcodecs DEPRECATION: Could not build wheels for numcodecs which do not use PEP 517. pip will fall back to legacy 'setup.py install' for these. pip 21.0 will remove support for this functionality. A possible replacement is to fix the wheel build issue reported above. You can find discussion regarding this at https://github.com/pypa/pip/issues/8368. Installing collected packages: cycler, kiwisolver, matplotlib, pyrsistent, attrs, zipp, importlib-metadata, jsonschema, nbformat, pycparser, cffi, argon2-cffi, webencodings, bleach, testpath, mistune, defusedxml, entrypoints, pandocfilters, nbconvert, Send2Trash, terminado, prometheus-client, notebook, widgetsnbextension, ipywidgets, ipympl, zstandard, itk-core, param, pyct, colorcet, itk-meshtopolydata, itk-numerics, itk-filtering, traittypes, ipydatawidgets, itkwidgets, tifffile, networkx, scipy, imageio, PyWavelets, scikit-image, itk-registration, itk-io, itk-segmentation, itk, itk-thickness3d, skan, llvmlite, numba, xarray, asciitree, monotonic, fasteners, numcodecs, zarr, ipytree, simpervisor, multidict, async-timeout, chardet, idna, yarl, aiohttp, jupyter-server-proxy, dask-labextension, urllib3, requests, cftime, itk-totalvariation Running setup.py install for numcodecs ... error ERROR: Command errored out with exit status 1: command: /global/homes/u/ushizima/.conda/envs/fibercam/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"'; file='"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-vb2aof27/install-record.txt --single-version-externally-managed --compile --install-headers /global/homes/u/ushizima/.conda/envs/fibercam/include/python3.7m/numcodecs cwd: /tmp/pip-install-kpz07wl0/numcodecs/ Complete output (134 lines): [numcodecs] setting up Blosc extension [numcodecs] compiling Blosc extension with SSE2 support [numcodecs] compiling Blosc extension with AVX2 support [numcodecs] setting up Zstandard extension [numcodecs] setting up LZ4 extension [numcodecs] setting up compat extension [numcodecs] setting up vlen extension running install running build running build_py creating build creating build/lib.linux-x86_64-3.7 creating build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/zlib.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/version.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/registry.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/quantize.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/pickles.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/packbits.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/msgpacks.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/lzma.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/json.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/gzip.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/fixedscaleoffset.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/delta.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/compat.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/checksum32.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/categorize.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/bz2.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/base64.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/astype.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/abc.py -> build/lib.linux-x86_64-3.7/numcodecs copying ./numcodecs/init.py -> build/lib.linux-x86_64-3.7/numcodecs creating build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_zstd.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_zlib.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_utf8.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_bytes.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_vlen_array.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_registry.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_quantize.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_pickles.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_packbits.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_msgpacks.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_lzma.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_lz4.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_json.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_gzip.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_fixedscaleoffset.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_delta.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_compat.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_checksum32.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_categorize.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_bz2.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_blosc.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_base64.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/test_astype.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/common.py -> build/lib.linux-x86_64-3.7/numcodecs/tests copying ./numcodecs/tests/init.py -> build/lib.linux-x86_64-3.7/numcodecs/tests running build_ext building 'numcodecs.blosc' extension creating build/temp.linux-x86_64-3.7 creating build/temp.linux-x86_64-3.7/numcodecs gcc -pthread -B /global/homes/u/ushizima/.conda/envs/fibercam/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_LZ4=1 -DHAVE_SNAPPY=1 -DHAVE_ZLIB=1 -DHAVE_ZSTD=1 -Ic-blosc/blosc -I/global/homes/u/ushizima/.conda/envs/fibercam/include/python3.7m -c numcodecs/blosc.c -o build/temp.linux-x86_64-3.7/numcodecs/blosc.o -msse2 -mavx2 -DSHUFFLE_SSE2_ENABLED -DSHUFFLE_AVX2_ENABLED numcodecs/blosc.c:705:10: fatal error: blosc.h: No such file or directory
^~~~~~~~~
compilation terminated.
[numcodecs] command 'gcc' failed with exit status 1
Traceback (most recent call last):
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/ccompiler.py", line 910, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 276, in build_extension
build_ext.build_extension(self, ext)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build_ext.py", line 534, in build_extension
depends=ext.depends)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 350, in <module>
run_setup(with_extensions)
File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 343, in run_setup
license='MIT',
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/site-packages/setuptools/__init__.py", line 163, in setup
return distutils.core.setup(**attrs)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/core.py", line 148, in setup
dist.run_commands()
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/site-packages/setuptools/command/install.py", line 61, in run
return orig.install.run(self)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/install.py", line 545, in run
self.run_command('build')
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 269, in run
build_ext.run(self)
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/global/homes/u/ushizima/.conda/envs/fibercam/lib/python3.7/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "/tmp/pip-install-kpz07wl0/numcodecs/setup.py", line 279, in build_extension
raise BuildFailed()
__main__.BuildFailed
----------------------------------------
ERROR: Command errored out with exit status 1: /global/homes/u/ushizima/.conda/envs/fibercam/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"'; file='"'"'/tmp/pip-install-kpz07wl0/numcodecs/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-vb2aof27/install-record.txt --single-version-externally-managed --compile --install-headers /global/homes/u/ushizima/.conda/envs/fibercam/include/python3.7m/numcodecs Check the logs for full command output.
We now have a conda environment.yml
file with all dependencies.
This fails: conda install --file requirements.txt Error: PackagesNotFoundError: The following packages are not available from current channels: