hellonarrativ / spectrify

Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
https://aws.amazon.com/blogs/big-data/narrativ-is-helping-producers-monetize-their-digital-content-with-amazon-redshift/
MIT License
116 stars 25 forks source link

Unable to install spectrify 1.0 due to environmental issues #21

Closed naveenarumugam closed 6 years ago

naveenarumugam commented 6 years ago

Description

Install spectrify 1.0 on Mac

What I Did

**sudo pip install spectrify**

google-cloud-pubsub 0.26.0 has requirement google-cloud-core<0.26dev,>=0.25.0, but you'll have google-cloud-core 0.28.0 which is incompatible.
google-cloud-storage 1.3.1 has requirement google-cloud-core<0.27dev,>=0.26.0, but you'll have google-cloud-core 0.28.0 which is incompatible.
quandl 3.2.0 has requirement requests<2.18,>=2.7.0, but you'll have requests 2.18.3 which is incompatible.
json2parquet 0.0.17 has requirement pandas==0.20.3, but you'll have pandas 0.22.0 which is incompatible.
json2parquet 0.0.17 has requirement pyarrow==0.8.0, but you'll have pyarrow 0.9.0 which is incompatible.
grpcio 1.8.4 has requirement protobuf>=3.5.0.post1, but you'll have protobuf 3.3.0 which is incompatible.
apache-beam 2.2.0 has requirement six<1.11,>=1.9, but you'll have six 1.11.0 which is incompatible.
pyasn1-modules 0.0.11 has requirement pyasn1==0.3.2, but you'll have pyasn1 0.4.2 which is incompatible.
awscli 1.14.44 has requirement botocore==1.8.48, but you'll have botocore 1.9.18 which is incompatible.
Installing collected packages: pyarrow, python-dateutil, spectrify
  Found existing installation: pyarrow 0.8.0
    Uninstalling pyarrow-0.8.0:
      Successfully uninstalled pyarrow-0.8.0
  Running setup.py install for pyarrow ... error
    Complete output from command /usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;__file__='/private/tmp/pip-install-cMRnA5/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/tmp/pip-record-tD_erd/install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.11-x86_64-2.7
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/__init__.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/compat.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/feather.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/filesystem.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/formatting.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/hdfs.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/ipc.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/orc.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/pandas_compat.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/parquet.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/serialization.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/types.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/util.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/__init__.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/conftest.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/deserialize_buffer.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_array.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_convert_pandas.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_cython.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_deprecations.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_feather.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_io.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_ipc.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_misc.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_parquet.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_plasma.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_scalars.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_schema.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_serialization.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_table.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_tensor.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/test_types.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    copying pyarrow/tests/util.py -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    running egg_info
    writing requirements to pyarrow.egg-info/requires.txt
    writing pyarrow.egg-info/PKG-INFO
    writing top-level names to pyarrow.egg-info/top_level.txt
    writing dependency_links to pyarrow.egg-info/dependency_links.txt
    writing entry points to pyarrow.egg-info/entry_points.txt
    reading manifest file 'pyarrow.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no previously-included files matching '*.so' found anywhere in distribution
    warning: no previously-included files matching '*.pyc' found anywhere in distribution
    warning: no previously-included files matching '*~' found anywhere in distribution
    warning: no previously-included files matching '#*' found anywhere in distribution
    warning: no previously-included files matching '.git*' found anywhere in distribution
    warning: no previously-included files matching '.DS_Store' found anywhere in distribution
    writing manifest file 'pyarrow.egg-info/SOURCES.txt'
    copying pyarrow/__init__.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/_config.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/_orc.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/_orc.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/_parquet.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/_parquet.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/array.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/error.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/feather.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/io-hdfs.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/io.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/ipc.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/lib.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/lib.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/lib_api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow.so.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow.so.0.0.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow_boost_filesystem.so.1.65.1 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow_boost_regex.so.1.65.1 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow_boost_system.so.1.65.1 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow_python.so.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libarrow_python.so.0.0.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libparquet.so.1 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libparquet.so.1.4.1 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libplasma.so.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/libplasma.so.0.0.0 -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/memory.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/plasma.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/plasma_store -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/public-api.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/scalar.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/serialization.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/table.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    copying pyarrow/types.pxi -> build/lib.macosx-10.11-x86_64-2.7/pyarrow
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/allocator.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/array.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/buffer.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/builder.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/compare.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/memory_pool.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/pretty_print.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/record_batch.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/status.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/stl.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/table.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/table_builder.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/tensor.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/test-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type_fwd.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type_traits.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/visitor.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/visitor_inline.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/adapters
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/adapters/orc
    copying pyarrow/include/arrow/adapters/orc/adapter.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/adapters/orc
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/context.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/kernel.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute/kernels
    copying pyarrow/include/arrow/compute/kernels/cast.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute/kernels
    copying pyarrow/include/arrow/compute/kernels/hash.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/compute/kernels
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/file.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/hdfs.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/interfaces.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/memory.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/io
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/dictionary.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/feather.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/json.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/message.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/reader.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/writer.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/ipc
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/api.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/arrow_to_pandas.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/arrow_to_python.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/builtin_convert.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/common.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/config.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/helpers.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/init.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/io.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_convert.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_interop.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_to_arrow.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/platform.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/pyarrow.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/python_to_arrow.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/type_traits.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/python
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bit-stream-utils.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bit-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bpacking.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compiler-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_brotli.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_lz4.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_snappy.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_zlib.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_zstd.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/cpu-info.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/decimal.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/hash-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/hash.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/io-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/key_value_metadata.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/logging.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/macros.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/memory.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/optional.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/parallel.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/recursive_wrapper.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/rle-encoding.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/sse-util.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/stl.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/string.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/type_traits.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_cast.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_io.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_visitor.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/visibility.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/optional.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/recursive_wrapper.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_cast.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_io.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_visitor.h -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/include/arrow/util/variant
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/includes
    copying pyarrow/includes/__init__.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/includes
    copying pyarrow/includes/common.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/includes
    copying pyarrow/includes/libarrow.pxd -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/includes
    copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests
    creating build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.all-named-index.parquet -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.column-metadata-handling.parquet -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.parquet -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.some-named-index.parquet -> build/lib.macosx-10.11-x86_64-2.7/pyarrow/tests/data
    running build_ext
    creating build/temp.macosx-10.11-x86_64-2.7
    -- Runnning cmake for pyarrow
    cmake -DPYTHON_EXECUTABLE=/usr/local/opt/python/bin/python2.7  -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_BUNDLE_BOOST=OFF -DCMAKE_BUILD_TYPE=debug /private/tmp/pip-install-cMRnA5/pyarrow
    unable to execute 'cmake': No such file or directory
    error: command 'cmake' failed with exit status 1

    ----------------------------------------
  Rolling back uninstall of pyarrow
Command "/usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;__file__='/private/tmp/pip-install-cMRnA5/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/tmp/pip-record-tD_erd/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/tmp/pip-install-cMRnA5/pyarrow/
naveenarumugam commented 6 years ago

After installing CMake separately, and resolving other few dependencies (uninstalls), I was able to install pyarrow-0.9.0.post1 . But, later on trying to use pyarrow, I received the error as described here:- https://github.com/apache/arrow/issues/1950#issuecomment-385561607 So, still working on to fix the issue.

naveenarumugam commented 6 years ago

On linux/CentOs, spectrify installation was just one step with no errors.

c-nichols commented 6 years ago

This is more a pyarrow issue than a spectrify issue. Suggest using docker, or even better a Linux desktop :)