-
Hi I want to run triton on cpu, i saw "That refers to the CPU support, which won't happen shortly, but you can offload triton to pytorch using the interpreter mode. https://github.com/openai/triton/c…
-
Both Codon and [Triton](https://github.com/openai/triton) can generate CUDA kernels. What are the differences between the two when it comes to GPU programming?
Thanks!
PS. This may be something …
-
Can Triton support split-k matrix multiplication?
-
tl.dot seems to not support when accumulator tile size < 16 (https://github.com/openai/triton/blob/854677046383bb3f0a30f3b2ba981b91fb9fb29f/python/triton/language/semantic.py#L1355C47-L1357C124)
Ma…
-
### Describe the bug
In the current version of `openai-triton`, `v2.1.0`, which is used to build pytorch, there's a [function that calls `ldconfig -p`](https://github.com/openai/triton/blob/da40a1e98…
-
你好,我在https://github.com/openai/triton/issues/1955
这个帖子中看到了你对这个问题的解释,我现在也遇到了相同的问题,我想有偿请您帮我解决一下,如果有兴趣,请通过hanforrest@163.com联系我
-
Hi Dustin,
thanks for your great work.
I was trying to run [mistral-7b](https://github.com/mistralai/mistral-src) on Jetson ORIN with Jetpack (# R35 (release), REVISION: 4.1, GCID: 33958178, B…
cj401 updated
6 months ago
-
### 🐛 Describe the bug
torch.compile is not supported on Windows.
torch.compile has dependency triton: https://github.com/openai/triton/issues/1640
### Expected outcome
1. Document the requir…
-
Dear authors, thanks so much for your fantastic work, I'm wondering if the IP adapter will be integrated in the Diffusion Backend someday? The IP Adapter pipeline should be suitable with SD 1.5, SDXL.…
-
hi,
where can i find documentation how to build triton inference server trt-llm 24.06 for sagemaker myself so i can run it on sagemaker?
Nvidia Image i want to use: nvcr.io/nvidia/tritonserver:2…