LLM inference in C/C++
68.47k
stars
9.83k
forks
source link
Compile bug: make CC='/opt/AMD/aocc-compiler-5.0.0/bin/clang' CXX='/opt/AMD/aocc-compiler-5.0.0/bin/clang++' AMD_ZEN4_BLIS_5=1 GGML_CUDA=1 GGML_CUDA_FORCE_CUBLAS=1 GML_CUDA_F16=1 GGML_CUDA_FORCE_MMQ=1 CUDA_USE_TENSOR_CORES=1 GGML_RPC=1 #10493
Open
KarlHeinzMali opened 3 days ago
Git commit
Build 4160
Which operating systems do you know to be affected?
Linux
GGML backends
BLAS, CPU, CUDA, RPC
Steps to Reproduce
Can't compile build 4160 with GGML_RPC=1
First Bad Commit
No response
Relevant log output