search

triton-lang / triton

Development repository for the Triton language and compiler
https://triton-lang.org/
MIT License
12.53k stars 1.52k forks source link

Can Triton support split-k matrix multiplication #2897

Open zhoutianzi666 opened 8 months ago

zhoutianzi666 commented 8 months ago

Can Triton support split-k matrix multiplication?

bertmaher commented 8 months ago

The provided triton.ops.matmul appears to do so: https://github.com/openai/triton/blob/main/python/triton/ops/matmul.py#L96

zhoutianzi666 commented 8 months ago

The provided triton.ops.matmul appears to do so: https://github.com/openai/triton/blob/main/python/triton/ops/matmul.py#L96

3Q

sleepwalker2017 commented 1 month ago

hi, have you try this? I try this but find it produce result with too large errors.