sasha0552
commented
2 months ago It's clearly not, since it's downloaded triton==3.0.0, which is not published in this repository (but is published on PyPI).
Can you try pip3 install --index-url https://sasha0552.github.io/vllm-ci/ --force-reinstall --no-deps triton? Also make sure it downloads triton==2.3.0 from github.com (if I remember correctly, it prints the URL when installing not from PyPI.)
As for "test if patch applied successfully" - the main indicator is that the following code does not cause a crash:
import torch
import triton
import triton.language as tl
@triton.jit
def test_max_kernel():
t = tl.zeros([2, 2], dtype=tl.float32)
m = tl.max(t, 1)
tl.device_print("max:", m)
@triton.jit
def test_sum_kernel():
t = tl.zeros([2, 2], dtype=tl.float32)
s = tl.sum(t, 1)
tl.device_print("sum:", s)
if True:
grid = lambda meta: (1, )
kernel = test_max_kernel[grid]()
if True:
grid = lambda meta: (1, )
kernel = test_sum_kernel[grid]()
cduk
I try to apply the triton patch like this:
pip3 install --extra-index-url https://sasha0552.github.io/vllm-ci/ --force-reinstall tritonWhich shows
So it managed to re-install, but it went suspiciously quickly and there's no indication whether the patches are applied or not. Is there a way to test this?