Closed asfimport closed 5 years ago
Joris Van den Bossche / @jorisvandenbossche: There are not yet binary wheels available for Python 3.8, so therefore pip is trying to build from source. And then it appears something goes wrong with installing/finding numpy, which seems similar to the error reported in ARROW-5210. As I mentioned there, this is an error in the pyproject.toml that we do not list numpy as a build dependency (pip will create a new environment with all build dependencies, therefore installing numpy before hand does not solve it).
Now, even if the pyproject.toml would correctly list this, it is quite likely that installing from source with just pip install pyarrow
is not going to work, as there are a lot of other (non-python) dependencies that you would need to ensure are available. If you do want to install from source, see https://arrow.apache.org/docs/developers/python.html#python-development for detailed instructions), otherwise you will need to wait until there are wheels available, or use Python 3.7 instead of 3.8, or use conda instead (conda-forge already has binary packages of pyarrow for Python 3.8).
Fabien / @fabiencelier: Hi ! Thanks for the answer !
It's nice to have it on conda but we use pyarrow as a dependency of our library so we cannot ensure that our users will use conda to install. I will still try it and mention it as a workaround for the pip users.
Any idea when a binary version will be available on pypi for 3.8 (and for which version ?)
Joris Van den Bossche / @jorisvandenbossche: See ARROW-6920 for wheels for Python 3.8 (I suppose they will only get added for the latest pyarrow release, 0.15.1)
Wes McKinney / @wesm: Duplicate of ARROW-6920
Manthan Admane: I don't know how and why- it gives me a "ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly"
When I am using a virtual env on anaconda BUT succeeds when I am using the (base) default environment.
Joris Van den Bossche / @jorisvandenbossche:
[~ManthanAdmane]
you will need to give more details (the exact commands you ran, the full output, which version you are installing, which platform, ...)
Manthan Admane: I am using Windows 10, Anaconda prompt as terminal for running the commands.
Command I used- "pip install pyarrow"
My pip freeze: anaconda-client==1.7.2 anaconda-navigator==1.9.7 appdirs==1.4.3 asn1crypto==1.3.0 astropy==2.0.9 atomicwrites==1.3.0 attrs==19.3.0 Automat==20.2.0 autopep8==1.5 backports.shutil-get-terminal-size==1.0.0 beautifulsoup4==4.6.3 bleach==3.1.4 bokeh==2.0.1 Bottleneck==1.2.1 certifi==2020.4.5.1 cffi==1.14.0 chardet==3.0.4 click==7.1.1 cloudpickle==0.7.0 clyent==1.2.2 colorama==0.4.3 conda==4.8.3 conda-build==3.10.9 conda-package-handling==1.3.11 conda-verify==3.0.0 constantly==15.1.0 crypto==1.4.1 cryptography==2.9.2 cssselect==1.1.0 cycler==0.10.0 cytoolz==0.10.0 dask==1.1.1 decorator==4.4.2 dill==0.3.1.1 distributed==1.28.1 dlib==19.7.0 entrypoints==0.3 et-xmlfile==1.0.1 fast-histogram==0.7 filelock==3.0.12 future==0.18.2 glob2==0.7 glue-core==0.13.4 glue-vispy-viewers==0.10 h5py==2.9.0 HeapDict==1.0.1 hyperlink==19.0.0 idna==2.9 imageio==2.8.0 imbalanced-learn==0.5.0 importlib-metadata==1.6.0 imutils==0.5.3 incremental==17.5.0 ipykernel==5.1.4 ipython==5.8.0 ipython-genutils==0.2.0 ipywidgets==7.5.1 jdcal==1.4.1 jedi==0.17.0 Jinja2==2.11.1 joblib==0.14.1 json5==0.9.4 jsonschema==2.6.0 jupyter-client==6.1.2 jupyter-core==4.6.3 jupyterlab==1.2.6 jupyterlab-server==1.0.0 kiwisolver==1.1.0 libarchive-c==2.9 locket==0.2.0 lxml==4.5.0 MarkupSafe==1.1.1 matplotlib==2.2.2 menuinst==1.4.16 mistune==0.8.4 more-itertools==8.2.0 mpl-scatter-density==0.5 msgpack==0.6.1 naked==0.1.31 navigator-updater==0.2.1 nbconvert==5.3.1 nbformat==5.0.4 nbopen==0.6 networkx==2.4 notebook==5.5.0 numpy==1.18.3 olefile==0.46 opencv-python==4.2.0.32 openpyxl==2.5.14 packaging==20.3 pandas==0.23.4 pandocfilters==1.4.2 parsel==1.5.2 parso==0.7.0 partd==1.1.0 pickleshare==0.7.5 Pillow==6.1.0 pkginfo==1.5.0.1 playsound==1.2.2 plotly==3.7.0 pluggy==0.11.0 prompt-toolkit==3.0.5 Protego==0.1.16 protobuf==3.8.0 psutil==5.6.3 ptpython==3.0.2 py==1.8.1 pyarrow==0.15.1 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycosat==0.6.3 pycparser==2.20 pycryptodome==3.9.7 PyDispatcher==2.0.5 Pygments==2.6.1 PyHamcrest==2.0.2 PyOpenGL==3.1.1a1 pyOpenSSL==19.1.0 pyparsing==2.4.6 pyreadline==2.1 PySocks==1.7.1 pytest==4.5.0 python-dateutil==2.8.1 pytz==2019.3 PyWavelets==1.0.3 pywin32==223 pywinpty==0.5.7 PyYAML==5.1.2 pyzmq==18.1.0 QtAwesome==0.5.6 qtconsole==4.7.3 QtPy==1.6.0 queuelib==1.5.0 requests==2.23.0 retrying==1.3.3 ruamel-yaml==0.15.46 scikit-fuzzy==0.4.2 scikit-image==0.15.0 scikit-learn==0.20.3 scipy==1.2.1 Scrapy==2.1.0 Send2Trash==1.5.0 service-identity==18.1.0 shellescape==3.8.1 simplegeneric==0.8.1 six==1.14.0 sortedcontainers==2.1.0 tblib==1.6.0 terminado==0.8.3 testpath==0.4.4 toml==0.10.0 toolz==0.10.0 tornado==6.0.3 tqdm==4.29.1 traitlets==4.3.3 Twisted==20.3.0 typing-extensions==3.7.4.1 urllib3==1.25.8 virtualenv==16.3.0 w3lib==1.21.0 wcwidth==0.1.9 webencodings==0.5.1 widgetsnbextension==3.5.1 win-inet-pton==1.1.0 wincertstore==0.2 wordcloud==1.6.0 xlrd==1.2.0 zict==2.0.0 zipp==3.1.0 zope.interface==5.1.0
and it worked without throwing a PEP 517 error.
Wes McKinney / @wesm:
[~ManthanAdmane]
the issue you're describing is beyond the scope of this JIRA issue. You can open a new issue but it sounds like there's something amiss with your environment (in general mixing virtualenv and conda is going to create headaches)
When I install pyarrow in python 3.7.5 with
pip install pyarrow
it works.However with python 3.8.0 it fails with the following error :
I see the line "ModuleNotFoundError: No module named 'numpy'" but installing numpy did not change anything.
Environment: Ubuntu 19.10 / Python 3.8.0 Reporter: Fabien / @fabiencelier
Related issues:
Note: This issue was originally created as ARROW-7076. Please see the migration documentation for further details.