-
I am attempting to follow the new Anaconda installation [setup instruction](https://github.com/unslothai/unsloth?tab=readme-ov-file#conda-installation)s for the `unsloth_env`, but I am experiencing se…
-
ERROR: Could not find a version that satisfies the requirement triton (from versions: none)
ERROR: No matching distribution found for triton
![image](https://github.com/user-attachments/assets/278f1…
-
**Description**
Triton build using `./build.py ` fails due to a warning (`-Werror=sign-compare`) which throws an error. The warning comes from `response_cache_test.cc` in the `core` repo ([here](http…
-
Description of problem:
I did some experiments to measure timing performance to compare standalone inference based on a TensorRT model vs Triton serving the TensorRT model using identical input on a …
-
hi,
where can i find documentation how to build triton inference server trt-llm 24.06 for sagemaker myself so i can run it on sagemaker?
Nvidia Image i want to use: nvcr.io/nvidia/tritonserver:2…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
_No …
-
### Describe the issue
Hello developers:
I followed guide `docs/ORT_Use_Triton_Kernel.md` and wanted to use triton kernel in ONNX runtime. But I encountered a error.
**test script:**
```bash
…
-
If you're planning to make this API somehow standardized it would be great to integrate Songlin Yang's excellent new Triton RWKV-6 implementation from FLA
https://github.com/sustcsonglin/flash-linear…
-
It seems that `triton` has recently switched to `mathlib` in lieu of `libdevice` which causes following errors in `nn.triton_based_modules`:
```bash
AttributeError: module 'triton.language' has no a…
-
when I'm calling `Sae.decode()`, it raises error:
Traceback (most recent call last):
File "", line 21, in triton_sparse_dense_matmul_kernel
KeyError: ('2-.-0-.-0-d82511111ad128294e9d31a6ac68423…