-
![image](https://github.com/user-attachments/assets/b2fbbab3-1cc8-4160-b446-b7e09b8089e7)
any suggestions?
11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHz 8 16
I…
-
### 🚀 The feature, motivation and pitch
@thomwolf and i have an idea to implement llama from scratch in pure triton, inspired by karpathy. liger kernel already contains most of the kernels except m…
-
![Screenshot from 2024-06-05 22-23-59](https://github.com/state-spaces/mamba/assets/89624489/fa4ae161-6a93-4a9b-b9d1-358783bfc30e)
Encountered an error here
RuntimeError: Triton Error [CUDA]: mi…
-
When I run pip install -e python I get this error:
```
Obtaining file:///C:/Users/Fireblade2534/Documents/Code/MeLLM/triton/python
Installing build dependencies ... done
Checking if build ba…
-
Is Triton supported?
-
Here is my error log. When I run it on one GPU, it works fine. But when I start to train it show errors below:
`TypeError: Caught TypeError in replica 1 on device 1.
Original Traceback (most recent …
-
[/usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py](https://localhost:8080/#) in make_llir(src, metadata, options, capability)
171 add_external_libs(src, names,…
-
Hi there, I'm trying to add Triton Server into our Yocto build for use with Deepstream. I've been able to add the Triton packages (triton-server triton-core triton-tensorrt-backend triton-client) into…
-
When it comes to fully production grade inference servers, TIS is very much optimized and open sourced. So an integration of this in dspy along with trt llm (#1094) would be some great additions.
-
Windows 11 cannot install Triton. How can I solve this problem?