mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k stars 835 forks source link

Can't load xFormers because of PyTorch 2.1.0+cu121 #59

Open russ22cox opened 10 months ago

russ22cox commented 10 months ago

I installed everything from the requirements, but when I run the demo, it tells me:

WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for: PyTorch 2.1.0+cu121 with CUDA 1201 (you have 2.1.0+cpu) Python 3.10.11 (you have 3.10.11) Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)

So I go over to that page and do

pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu121

But everything comes up "Requirement already satisfied". I don't know what else I can do to switch from 2.1.0+cpu to 2.1.0+cu121

Techno-Blueberry commented 10 months ago

I have the same issue and kept trying to manually reinstall these things, but it would always say somewhere in the error (you have 2.1.0+cpu). It's odd because this is a new problem and to my knowledge nothing has changed but yet now the error haunts me.

aleccologne commented 9 months ago

Same here