Open AayushSameerShah opened 11 months ago
CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install ctransformers
to compile, add no-binary
as such: [...] pip install ctransformers --no-binary ctransformers
How to know if my CPU supports BLAS?
you don't; blas is software
When I monitor the CPU usage while inference, it only uses 50% of the CPU.
increase threads
I am trying to run the project on Linux and I installed the library using following:
Q: How to know if my CPU supports BLAS?
Is there any way to know beforehand? I got no error, nothing.
Instance information
One more note...
When I monitor the CPU usage while inference, it only uses 50% of the CPU.
Please help me get out of this. Thanks!