AnswerDotAI / RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.
Apache License 2.0
3.08k stars 210 forks source link

ragatouille requires a version of numpy uncompatible with python #226

Open PetitmanginBearing opened 5 months ago

PetitmanginBearing commented 5 months ago

During the execution of the docker build command, I am encountering an issue at the 'pip install requirements.txt' step. The problem arises specifically with the installation of the ragatouille package. The build process fails when attempting to install this package, which appears to be causing the overall build to terminate prematurely.

Collecting faiss-cpu<2.0.0,>=1.7.4 (from ragatouille->-r requirements.txt (line 27)) 12.66 Downloading faiss_cpu-1.8.0.post1.tar.gz (63 kB) 12.66 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.7/63.7 kB 367.4 MB/s eta 0:00:00 12.68 Installing build dependencies: started 31.56 Installing build dependencies: finished with status 'error' 31.58 error: subprocess-exited-with-error 31.58 31.58 × pip subprocess to install build dependencies did not run successfully. 31.58 │ exit code: 1 31.58 ╰─> [304 lines of output] 31.58 Collecting setuptools 31.58 Using cached setuptools-70.1.0-py3-none-any.whl.metadata (6.0 kB) 31.58 Collecting wheel 31.58 Downloading wheel-0.43.0-py3-none-any.whl.metadata (2.2 kB) 31.58 Collecting oldest-supported-numpy 31.58 Downloading oldest_supported_numpy-2023.12.21-py3-none-any.whl.metadata (9.8 kB) 31.58 Collecting numpy==1.23.2 (from oldest-supported-numpy) 31.58 Downloading numpy-1.23.2.tar.gz (10.7 MB) 31.58 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.7/10.7 MB 12.0 MB/s eta 0:00:00 31.58 Installing build dependencies: started 31.58 Installing build dependencies: finished with status 'done' 31.58 Getting requirements to build wheel: started 31.58 Getting requirements to build wheel: finished with status 'done' 31.58 Preparing metadata (pyproject.toml): started 31.58 Preparing metadata (pyproject.toml): finished with status 'done' 31.58 Using cached setuptools-70.1.0-py3-none-any.whl (882 kB) 31.58 Downloading wheel-0.43.0-py3-none-any.whl (65 kB) 31.58 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.8/65.8 kB 3.3 MB/s eta 0:00:00 31.58 Downloading oldest_supported_numpy-2023.12.21-py3-none-any.whl (4.9 kB) 31.58 Building wheels for collected packages: numpy 31.58 Building wheel for numpy (pyproject.toml): started 31.58 Building wheel for numpy (pyproject.toml): finished with status 'error' 31.58 error: subprocess-exited-with-error 31.58 31.58 × Building wheel for numpy (pyproject.toml) did not run successfully. 31.58 │ exit code: 1 31.58 ╰─> [268 lines of output] 31.58 setup.py:71: RuntimeWarning: NumPy 1.23.2 may not yet support Python 3.11.

It seems that the issue occurs because of the sub-package 'oldest_supported_numpy' which then force to install a version of numpy uncompatible with the version of python you are using, regardless of the version of python (I have tried 8, 9, 10, 11). Do you know what can I do to work around this problem?

Many thanks in advance