conda-forge / pyarrow-feedstock

A conda-smithy repository for pyarrow.
BSD 3-Clause "New" or "Revised" License
6 stars 26 forks source link

NumPy ABI warning #61

Closed wesm closed 5 years ago

wesm commented 5 years ago

Got this in a fresh environment installed this morning

In [1]: import pyarrow as pa                                                                   
/home/wesm/miniconda/envs/pyarrow-conda-test/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
  return f(*args, **kwds)

This is concerning, should we rebuild the package using latest dependencies?

xhochy commented 5 years ago

This looks for me more like a pandas problem:

uwe@Uwes-MacBook-Pro ~/tmp % ipython
Python 3.7.1 | packaged by conda-forge | (default, Nov 13 2018, 09:50:42)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.2.0 -- An enhanced Interactive Python. Type '?' for help.

In [1]: import traceback
   ...: import warnings
   ...: import sys
   ...:
   ...: def warn_with_traceback(message, category, filename, lineno, file=None, line=None):
   ...:
   ...:     log = file if hasattr(file,'write') else sys.stderr
   ...:     traceback.print_stack(file=log)
   ...:     log.write(warnings.formatwarning(message, category, filename, lineno, line))
   ...:
   ...: warnings.showwarning = warn_with_traceback

In [2]: import pyarrow
  File "/Users/uwe/tmp/testenv/bin/ipython", line 11, in <module>
    sys.exit(start_ipython())
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/__init__.py", line 125, in start_ipython
    return launch_new_instance(argv=argv, **kwargs)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/traitlets/config/application.py", line 658, in launch_instance
    app.start()
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/terminal/ipapp.py", line 356, in start
    self.shell.mainloop()
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/terminal/interactiveshell.py", line 494, in mainloop
    self.interact()
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/terminal/interactiveshell.py", line 485, in interact
    self.run_cell(code, store_history=True)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 2819, in run_cell
    raw_cell, store_history, silent, shell_futures)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 2845, in _run_cell
    return runner(coro)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/async_helpers.py", line 67, in _pseudo_sync_runner
    coro.send(None)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3020, in run_cell_async
    interactivity=interactivity, compiler=compiler, result=result)
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3185, in run_ast_nodes
    if (yield from self.run_code(code, result)):
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3267, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-2-f1048abcb32d>", line 1, in <module>
    import pyarrow
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/pyarrow/__init__.py", line 45, in <module>
    import pyarrow.compat as compat
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/pyarrow/compat.py", line 34, in <module>
    import pandas as pd
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/pandas/__init__.py", line 26, in <module>
    from pandas._libs import (hashtable as _hashtable,
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/uwe/tmp/testenv/lib/python3.7/site-packages/pandas/_libs/__init__.py", line 4, in <module>
    from .tslib import iNaT, NaT, Timestamp, Timedelta, OutOfBoundsDatetime
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 670, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 583, in module_from_spec
  File "<frozen importlib._bootstrap_external>", line 1043, in create_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/uwe/tmp/testenv/lib/python3.7/warnings.py", line 99, in _showwarnmsg
    msg.file, msg.line)
  File "<ipython-input-1-d602e1b4df11>", line 8, in warn_with_traceback
    traceback.print_stack(file=log)
/Users/uwe/tmp/testenv/lib/python3.7/importlib/_bootstrap.py:219: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
  return f(*args, **kwds)
xhochy commented 5 years ago

This problem no longer exists. Probably due to the compiler rebuild everything is now in a better state.