-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Hi,
I am trying to run it on my mac, however it shows that cannot find the shared libray "llama"
Here is the error message.
`
(llama) chen@chenshuodeMBP-9 llama-cpp-python % python3 -m llama_cp…
-
Having 32 GB of GPU and 64GB of ram intel 17 13th gen processor its taking 2-4 min to response and not using GPU using llama-cpp-python==0.1.83 --no-cache-dir
. I tried to install this library as written in the README by running
`CMAKE_ARGS="-DLLAMA_HIPBLAS=on" FORCE_CMAKE=1 pip …
-
### System Info
CPU x86_64
GPU L40s
TensorRT branch: main
commid id:b57221b764bc579cbb2490154916a871f620e2c4
CUDA:
| NVIDIA-SMI 535.154.05 Driver Version: 535.154.05 CUDA V…