-
### Description
I noticed in [Veros](https://github.com/team-ocean/veros) that we would sometimes observe solver divergences on GPU, but not on CPU. I've isolated the problem to a kernel that gives d…
-
### What happened?
```
$ CUDA_VISIBLE_DEVICES=0 build/bin/Release/rpc-server -p 50052 --mem 10000
create_backend: using CUDA backend
ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
ggml_cuda_init: G…
-
### Your current environment
When running gemma2 7b, an error is reported [rank0]: RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling `cublasGemmEx( handle, opa, opb, m, n, k, &fal…
-
### Describe the bug
Am unable to compile the most recent commits with CUDA backend. Have been trying for the past week. Was however able to install the release: https://github.com/intel/llvm/relea…
-
e8717464 / #1507 introduces a regression around reductions on in-order queues when instant submission is active.
Found via bisecting AdaptiveCpp, it reliably causes Celerity test suite to fail. Cre…
-
Hello,
I've been working with AdaptiveCpp and oneAPI, targeting multiple backends including CPU and CUDA through AdaptiveCpp, as well as CPU@OpenCL and Level Zero through oneAPI. Across all configu…
-
I have been trying to compile the Llama ROS package with the two lines of the cmake file uncommented:
option(LLAMA_CUDA "llama: use CUDA" ON)
add_compile_definitions(GGML_USE_CUDA)
I receive er…
-
When I execute main.exe which I have built with github actions and cx_Freeze i am getting the following error:
`Could not locate cudnn_ops_infer64_8.dll. Please make sure it is in your library pat…
-
### Describe the bug
Building VS project failed when the backend is CUDA 12.5.
### Steps to reproduce
1. Prerequisites:
1. Windows 11,
2. CUDA 12.5,
3. MSVC 19.41 (VS 2022 Preview),
…
-
I found and isolated an error in `ggml_get_rows` with the cuda backend where for tensors of where the first dimension is greater than `65535`, the program fails with the following output:
````
loa…