search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

precompiled rocm and metal wheels #193

Open ParisNeo opened 6 months ago

ParisNeo commented 6 months ago

Thank you for this good and cool project. I was wondering if you could make a metal and rocm wheels and post them on pypi. This makes install easier since they don't need to recompile if they have rocm or metal device.

pip install ctransformers[cuda]
pip install ctransformers[rocm]
pip install ctransformers[metal]