-
Hi
Can we use this with Triton inference server model?
-
ERROR: Could not find a version that satisfies the requirement triton==2.0.0 (from versions: none)
ERROR: No matching distribution found for triton==2.0.0
My system is Linux_arch64, and I can't inst…
-
flash attention benchmark fails with [changes](https://github.com/intel/intel-xpu-backend-for-triton/pull/1905) to use upstream pytorch.
It should be a torch issue.
```
Traceback (most recent c…
-
I would like to know what features Triton will develop and support in the future, but I can't find any information on the homepage.
-
2. Ratio of `Triton`/ `XeTLA` keep same except for attention caused by `XeTLA` attention absolute number degraded
3. Both `Triton` and `XeTLA` softmax cases degraded, so `Triton`/ `XeTLA` not changed…
-
# YOLOv8 with TensorRT & Nvidia Triton Server | VISION HONG
Intro
[https://visionhong.github.io/tools/YOLOv8-with-TensorRT-Nvidia-Triton-Server/](https://visionhong.github.io/tools/YOLOv8-with-Tenso…
-
We'd like to do some indexing in triton kernels,
say we have **x_ptr, idx_ptr, out_ptr**
```
x = tl.load(x_ptr + offsets, mask = mask)
idx = tl.load(idx_ptr + offsets, mask = mask)
```
we have:…
-
When i try to install this program from cargo i get the below output. I am able to install by cloning the repo and running `cargo install --path .`
```sh
error[E0308]: mismatched types
--> /U…
-
`pip install -r requirements.txt
Collecting fire (from -r requirements.txt (line 1))
Using cached fire-0.6.0.tar.gz (88 kB)
Preparing metadata (setup.py) ... done
ERROR: Could not find a ver…
-
1.FlagGems后期是作为一个单独的仓库还是会在某个时间点把算子库合到Triton社区,随Triton社区一起维护么?
2.假如作为一个单独仓库独立演进,Triton后面若有大的版本更新,当前的一些表达、用法不再支持,FlagGems怎么解决?
3.若后期由于某些政治或其他不可抗力因素,Triton不再完全开源,此时又如何解决?
感谢解答!