mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.37k stars 817 forks source link

Installation Problem #124

Open jahbini opened 5 months ago

jahbini commented 5 months ago

I am stuck at the point of pip's refusal to install the requirements.txt (unchanged from the current repository) requirements.txt pip --debug install -r requirements.txt >1.log 2>2.log results in this: 1.log and stderr says: 2.log

I'm on an 8G MacBook Pro with OS Sonoma 14.2.1

JulienMT commented 4 months ago

Hi, i have the same problem on Windows 11, it crash on installing xformers that is not finding torch, but it is installed and available, don't know how to correct this xformers problem

`Collecting xformers==0.0.21 Downloading xformers-0.0.21.tar.gz (22.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22.3/22.3 MB 7.2 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [20 lines of output] Traceback (most recent call last): File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64qbz5n2kfra8p0\Lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 353, in main() File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 335, in main json_out['return_val'] = hook(**hook_input['kwargs']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64qbz5n2kfra8p0\Lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 118, in get_requires_for_build_wheel return hook(config_settings) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\money\AppData\Local\Temp\pip-build-env-tschzoch\overlay\Lib\site-packages\setuptools\build_meta.py", line 325, in get_requires_for_build_wheel return self._get_build_requires(config_settings, requirements=['wheel']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\money\AppData\Local\Temp\pip-build-env-tschzoch\overlay\Lib\site-packages\setuptools\build_meta.py", line 295, in _get_build_requires self.run_setup() File "C:\Users\money\AppData\Local\Temp\pip-build-env-tschzoch\overlay\Lib\site-packages\setuptools\build_meta.py", line 487, in run_setup super().run_setup(setup_script=setup_script) File "C:\Users\money\AppData\Local\Temp\pip-build-env-tschzoch\overlay\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup exec(code, locals()) File "", line 23, in ModuleNotFoundError: No module named 'torch' [end of output]`

Raphael2b3 commented 1 month ago

do you have an extra GPU?

kbocock-krg commented 1 month ago

Hi M1 mac same problem.

cedricsap commented 1 week ago

Hi, same issue on 3.12.4 on a M2 Mac and when trying to install mistral_inference-1.3.1

EDIT: Upon further research, I think this is normal behaviour as my host doesn't support a GPU which is required:

Note: You will use a GPU to install mistral-inference, as it currently requires xformers to be installed and xformers itself needs a GPU for installation.