marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

Cuda 11.8 #170

Open JeanChristopheMorinPerso opened 8 months ago

JeanChristopheMorinPerso commented 8 months ago

Hello, from what I see and understand from the CMakeLists.txt, the current version is compatible with cuda 12.0 and greater. Would it be safe if I compile using 11.8?

Thanks!

gorkemgoknar commented 8 months ago

you need a little fix https://github.com/marella/ctransformers/issues/90