-
**Description**
bug when deploying Macbert
**Triton Information**
I use the official image: nvcr.io/nvidia/tritonserver:21.09-py3
```
NVIDIA Release 21.09 (build 27443074)
Copyright (c) 20…
-
Hi! Can it use CUDA as backend?
-
I encountered an error while compiling **CUDA** code using **clang++-18**. The error message is as follows:
```
fatal error: error in backend: Cannot select: 0x55722baf9d20: i64,ch = stacksave 0x557…
-
### Description
I use KernelMemory. LogiBits is empty.
The error occurs at the time of the call:
memory.AskAsync()
![Screenshot_1](https://github.com/user-attachments/assets/e563258c-371e-41…
-
### What is the issue?
"ollama run qwen2" command loads until timeout
**Seeking help:**
How can I resolve this high CPU utilization issue with Ollama?
Is it possible to configure JIT compilati…
-
We select the backend at build time by selecting CUDA, Vulkan, SYCL, etc. Wouldn't it be better if you build with the backends you want to support and then select the backend at runtime? It's literall…
-
### 🐛 Describe the bug
My code fails when trying to use torch profiler (https://github.com/pytorch/pytorch/blob/main/torch/profiler/profiler.py) to record memory traces in combination with torch dist…
-
In no particular order (as of https://github.com/openjournals/joss-reviews/issues/6838#issuecomment-2295424005)...
## Line 14
```
to the Kolmogorov constant ...
```
For those not in the fie…
-
How did you accomplish installing this with the CUDA backend? I am using the nvidia/cuda-8.0 ubuntu 14.04 docker image to try and compile but it keeps failing. I have toyed with it quite a bit so in…
-
Hi,
Thanks for open sourcing!
I wonder is there an easy way to compile the program to CUDA kernels? It seems CUDA is not one of the backends supported by evaluate(), but the triangulation and perli…