Not able to build Numba and LLVM wheel for raiwidgets

[lalita90]

I have Numba == '0.56.4' and llvmlite == '0.39.1' on Python 3.10. I am trying to install raiwidgets on my Mac and fail to build the wheel for Numba and llvmlite. Please guide me how can I proceed ahead

Collecting numba<0.54.0

Collecting llvmlite<0.35,>=0.34.0.dev0 Building wheels for collected packages: numba, llvmlite Building wheel for numba (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [797 lines of output] TBB not found Using OpenMP from: /Users/lmeena/miniconda3 running bdist_wheel running build got version from file /private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/numba_f3c6cfe1011846519da61bcbfee07e4e/numba/_version.py {'version': '0.51.2', 'full': '9d570961590c09a1eba748c9c37e91d1224fc9ad'} running build_py creating build

  creating build/lib.macosx-11.1-arm64-cpython-310/numba/stencils

  running build_ext
  building 'numba._dynfunc' extension
  Warning: Can't read registry to find the necessary compiler setting
  Make sure that Python modules winreg, win32api or win32con are installed.
  INFO: C compiler: clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /Users/lmeena/miniconda3/include -arch arm64 -fPIC -O2 -isystem /Users/lmeena/miniconda3/include -arch arm64

  creating build/temp.macosx-11.1-arm64-cpython-310
  creating build/temp.macosx-11.1-arm64-cpython-310/numba
  INFO: compile options: '-I/Users/lmeena/miniconda3/include/python3.10 -c'
  extra options: '-g'
  INFO: clang: numba/_dynfuncmod.c
  INFO: clang -bundle -undefined dynamic_lookup -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib build/temp.macosx-11.1-arm64-cpython-310/numba/_dynfuncmod.o -o build/lib.macosx-11.1-arm64-cpython-310/numba/_dynfunc.cpython-310-darwin.so
  ld: warning: -undefined dynamic_lookup may not work with chained fixups
  building 'numba._dispatcher' extension
  INFO: C compiler: clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /Users/lmeena/miniconda3/include -arch arm64 -fPIC -O2 -isystem /Users/lmeena/miniconda3/include -arch arm64

  creating build/temp.macosx-11.1-arm64-cpython-310/numba/core
  creating build/temp.macosx-11.1-arm64-cpython-310/numba/core/typeconv
  INFO: compile options: '-I/Users/lmeena/miniconda3/lib/python3.10/site-packages/numpy/core/include -I/Users/lmeena/miniconda3/include/python3.10 -c'
  INFO: clang: numba/_dispatcher.c
  INFO: clang: numba/_dispatcherimpl.cpp
  INFO: clang: numba/_hashtable.c
  INFO: clang: numba/_typeof.c
  INFO: clang: numba/core/typeconv/typeconv.cpp
  numba/_dispatcher.c:26:13: error: no member named 'use_tracing' in 'struct _ts'
      tstate->use_tracing = 0;
      ~~~~~~  ^
  numba/_dispatcher.c:28:13: error: no member named 'use_tracing' in 'struct _ts'
      tstate->use_tracing = ((tstate->c_tracefunc != NULL)
      ~~~~~~  ^
  numba/_dispatcher.c:303:17: error: no member named 'use_tracing' in 'struct _ts'
      if (tstate->use_tracing && tstate->c_profilefunc)
          ~~~~~~  ^
  numba/_dispatcher.c:512:13: error: no member named 'use_tracing' in 'struct _ts'
      if (ts->use_tracing && ts->c_profilefunc) {
          ~~  ^
  4 errors generated.
  INFO: clang++ -bundle -undefined dynamic_lookup -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib build/temp.macosx-11.1-arm64-cpython-310/numba/_dispatcher.o build/temp.macosx-11.1-arm64-cpython-310/numba/_dispatcherimpl.o build/temp.macosx-11.1-arm64-cpython-310/numba/_hashtable.o build/temp.macosx-11.1-arm64-cpython-310/numba/_typeof.o build/temp.macosx-11.1-arm64-cpython-310/numba/core/typeconv/typeconv.o -L/Users/lmeena/miniconda3/lib/python3.10/site-packages/numpy/core/lib -lnpymath -o build/lib.macosx-11.1-arm64-cpython-310/numba/_dispatcher.cpython-310-darwin.so
  clang: error: no such file or directory: 'build/temp.macosx-11.1-arm64-cpython-310/numba/_dispatcher.o'
  error: Command "clang++ -bundle -undefined dynamic_lookup -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib -Wl,-rpath,/Users/lmeena/miniconda3/lib -L/Users/lmeena/miniconda3/lib build/temp.macosx-11.1-arm64-cpython-310/numba/_dispatcher.o build/temp.macosx-11.1-arm64-cpython-310/numba/_dispatcherimpl.o build/temp.macosx-11.1-arm64-cpython-310/numba/_hashtable.o build/temp.macosx-11.1-arm64-cpython-310/numba/_typeof.o build/temp.macosx-11.1-arm64-cpython-310/numba/core/typeconv/typeconv.o -L/Users/lmeena/miniconda3/lib/python3.10/site-packages/numpy/core/lib -lnpymath -o build/lib.macosx-11.1-arm64-cpython-310/numba/_dispatcher.cpython-310-darwin.so" failed with exit status 1
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for numba Running setup.py clean for numba

Building wheel for llvmlite (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [26 lines of output] running bdist_wheel /Users/lmeena/miniconda3/bin/python /private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py LLVM version... Traceback (most recent call last): File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 105, in main_posix out = subprocess.check_output([llvm_config, '--version']) File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 421, in check_output return run(popenargs, stdout=PIPE, timeout=timeout, check=True, File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 503, in run with Popen(popenargs, **kwargs) as process: File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 971, in init self._execute_child(args, executable, preexec_fn, close_fds, File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 1847, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: 'llvm-config'

  During handling of the above exception, another exception occurred:

  Traceback (most recent call last):
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 191, in <module>
      main()
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 185, in main
      main_posix('osx', '.dylib')
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 107, in main_posix
      raise RuntimeError("%s failed executing, please point LLVM_CONFIG "
  RuntimeError: llvm-config failed executing, please point LLVM_CONFIG to the path for llvm-config
  error: command '/Users/lmeena/miniconda3/bin/python' failed with exit code 1
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for llvmlite Running setup.py clean for llvmlite Failed to build numba llvmlite Installing collected packages: llvmlite, itsdangerous, scikit-learn, numba, gevent, Flask, statsmodels, sparse, shap, ipykernel, Flask-Cors, fairlearn, dice-ml, rai-core-flask, econml, responsibleai, raiwidgets Attempting uninstall: llvmlite Found existing installation: llvmlite 0.39.1 Uninstalling llvmlite-0.39.1: Successfully uninstalled llvmlite-0.39.1 Running setup.py install for llvmlite ... error error: subprocess-exited-with-error

× Running setup.py install for llvmlite did not run successfully. │ exit code: 1 ╰─> [31 lines of output] running install /Users/lmeena/miniconda3/lib/python3.10/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( running build got version from file /private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/llvmlite/_version.py {'version': '0.34.0', 'full': 'c5889c9e98c6b19d5d85ebdd982d64a03931f8e2'} running build_ext /Users/lmeena/miniconda3/bin/python /private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py LLVM version... Traceback (most recent call last): File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 105, in main_posix out = subprocess.check_output([llvm_config, '--version']) File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 421, in check_output return run(popenargs, stdout=PIPE, timeout=timeout, check=True, File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 503, in run with Popen(popenargs, **kwargs) as process: File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 971, in init self._execute_child(args, executable, preexec_fn, close_fds, File "/Users/lmeena/miniconda3/lib/python3.10/subprocess.py", line 1847, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: 'llvm-config'

  During handling of the above exception, another exception occurred:

  Traceback (most recent call last):
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 191, in <module>
      main()
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 185, in main
      main_posix('osx', '.dylib')
    File "/private/var/folders/40/w4b2sfn55137nx2p8y9l1kfrh3hjcb/T/pip-install-4oe4fwdb/llvmlite_83ca82da771a413da3582fbbe23a40c1/ffi/build.py", line 107, in main_posix
      raise RuntimeError("%s failed executing, please point LLVM_CONFIG "
  RuntimeError: llvm-config failed executing, please point LLVM_CONFIG to the path for llvm-config
  error: command '/Users/lmeena/miniconda3/bin/python' failed with exit code 1
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. Rolling back uninstall of llvmlite Moving to /Users/lmeena/miniconda3/lib/python3.10/site-packages/llvmlite from /Users/lmeena/miniconda3/lib/python3.10/site-packages/~lvmlite Moving to /Users/lmeena/miniconda3/lib/python3.10/site-packages/llvmlite-0.39.1-py3.10.egg-info from /Users/lmeena/miniconda3/lib/python3.10/site-packages/~lvmlite-0.39.1-py3.10.egg-info error: legacy-install-failure

× Encountered error while trying to install package. ╰─> llvmlite

note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure. Note: you may need to restart the kernel to use updated packages.

[konabuta]

@lalita90 Do you use Apple silicon?

[lalita90]

Hi, yes its Apple M1 Pro. I also tried doing this after downgrading my Python version to 3.9 but it doesn't work. Surprisingly, I was able to install the same on my macbook air with M1 chip but it runs out of memory and restarts the kernel as soon as I import it in macbook air.

[lalita90]

@konabuta any update on this error? It's still not working

[krisbock]

Looks like the raiwidget versions for numba/llvm break on python 3.10. Try 3.9

[njacobson-nci]

numba has been pinned to <0.54.0 in the responsibleai requirements.txt for 2 years, that version of numba and it's required llvm only support up to python 3.9.

Not sure this requirement is still needed but it will need to be updated to use this repo with anything newer than python 3.9