castorini / pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
http://pyserini.io/
Apache License 2.0
1.57k stars 349 forks source link

Error When Setting Up Pyserini: python -m spacy download en_core_web_sm #1918

Closed bxnsari2312 closed 1 month ago

bxnsari2312 commented 1 month ago

Hello, I tried to follow the Development Installation in step 2 for the setup, the pip install -e . was successful but when I moved onto the next step: python -m spacy download en_core_web_sm I kept encountering the error listed below, I have tried to restart everything by removing the env, but I keep coming back to the error below:

(pyserini_env) bansarishah@Bansaris-MBP pyserini % python -m spacy download en_core_web_sm Traceback (most recent call last): File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/runpy.py", line 187, in _run_module_as_main mod_name, mod_spec, code = _get_module_details(mod_name, _Error) File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/runpy.py", line 146, in _get_module_details return _get_module_details(pkg_main_name, error) File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/runpy.py", line 110, in _get_module_details import(pkg_name) File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/spacy/init.py", line 6, in from .errors import setup_default_warnings File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/spacy/errors.py", line 3, in from .compat import Literal File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/spacy/compat.py", line 39, in from thinc.api import Optimizer # noqa: F401 File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/thinc/api.py", line 1, in from .backends import ( File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/thinc/backends/init.py", line 17, in from .cupy_ops import CupyOps File "/Users/bansarishah/miniconda3/envs/pyserini_env/lib/python3.10/site-packages/thinc/backends/cupy_ops.py", line 16, in from .numpy_ops import NumpyOps File "thinc/backends/numpy_ops.pyx", line 1, in init thinc.backends.numpy_ops ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject