Open thistleknot opened 11 months ago
note works in 12.2 but not 11.7/11.8 :/ too bad soo sad for my 4GB VRAM cards
@thistleknot - Here is a fix that worked for me: https://github.com/marella/ctransformers/issues/90#issuecomment-1734127938
Thank you
I got llama.cpp to work on one card that Max's out on compute 5.2 by setting the compute capability explicitly in the makelist file. I presume this is similar. However I have yet to test similar changes on this. Will try sometime this week hopefully
On Mon, Sep 25, 2023, 9:59 AM Sujeendran Menon @.***> wrote:
@thistleknot https://github.com/thistleknot - Here is a fix that worked for me: #90 (comment) https://github.com/marella/ctransformers/issues/90#issuecomment-1734127938
— Reply to this email directly, view it on GitHub https://github.com/marella/ctransformers/issues/139#issuecomment-1734136815, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABHKKOUZU64EOXOPDJ42VTLX4GZ6HANCNFSM6AAAAAA45OK5KU . You are receiving this because you were mentioned.Message ID: @.***>
i also got this error but following commands worked for me.
pip install ctransformers[cuda] run above command and run your project code.
What cuda drivers are needed?
I'm able to run llama-cpp-pyhon and llama.cpp just fine, but not this tool
Ubuntu 22 Cuda 11.7 driver is 515.43.04