Closed SoftologyPro closed 11 months ago
I'm running into the same issue. One thing I'm noticing is that grammar.py is importing "torch_grammar" whereas the update script is installing "torch-grammar".
See #4369
Looks like the releases are only for version 12 of CUDA now. https://github.com/bdashore3/flash-attention/releases
And the above installer log error, is trying to download 11.8 Cuda flash attention https://github.com/bdashore3/flash-attention/releases/download/2.3.2-2/flash_attn-2.3.2+cu118-cp311-cp311-win_amd64.whl
And the files are moved here for 11.8 etc.... (according to the top of the page here github.com/bdashore3/flash-attention/releases) https://github.com/Dao-AILab/flash-attention/releases/tag/v2.3.2
did anyone find a solution for this? I'm having the same issue. this are what I tried so far:
\text-generation-webui\installer_files\conda\Scripts\activate.bat
and then,
pip install gradio
(gradio installed but still having the same issue when I run 'start_windows.bat')
none worked.
EDIT: so I run:
\text-generation-webui\installer_files\env\Scripts\pip.exe install gradio
then run the 'update_windows.bat' and 'start_windows.bat'. now it works.
This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.
Describe the bug
Windows installer broken.
Is there an existing issue for this?
Reproduction
Select NVIDIA and CUDA 11.8 during install.
Edit: since posting this error I installed using NVIDIA and CUDA 12.1 (I have CUDA 11.8) and it worked! Shouldn't 12.1 need CUDA 12.1 installed? So if the 12.1 option works with CUDA 11.8, maybe just use 12.1 by default and do not prompt the user.
Screenshot
No response
Logs
System Info