search

jllllll / bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.
MIT License
344 stars 35 forks source link

UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. #2

Closed melwazir closed 1 year ago

melwazir commented 1 year ago

I get this error on Windows 10, NVIDIA GTX 1050 Ti, CUDA version 10.1. I'm assuming my CUDA version is the problem since I don't see it listed among the versions this is compiled for. If that is the case, would it be possible to add support for 10.x? I have several old projects which I'm worried might break if I upgrade CUDA. Thanks.

jllllll commented 1 year ago

I can't get the 10.x toolkits to install on my system, so I am unable to do this. If I am ever able to get the 10.x toolkit installers to work, I'll try to do this.

melwazir commented 1 year ago

Appreciated!

On Sun, Apr 23, 2023, 7:51 PM jllllll @.***> wrote:

I can't get the 10.x toolkits to install on my system, so I am unable to do this. If I am ever able to get the 10.x toolkit installers to work, I'll try to do this.

— Reply to this email directly, view it on GitHub https://github.com/jllllll/bitsandbytes-windows-webui/issues/2#issuecomment-1519120155, or unsubscribe https://github.com/notifications/unsubscribe-auth/AI2KIFYIMKC6TCSDCH3O2QLXCVTY3ANCNFSM6AAAAAAXITNDYA . You are receiving this because you authored the thread.Message ID: @.***>