Support for cuda 11.8 and above

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

MIT License

1.76k stars 137 forks source link

Open sujeendran opened 8 months ago

sujeendran commented 8 months ago

This change allows CUDA 11.8 users to use ctransformers with GPU support. #90 #170 #139