Closed yrcong closed 2 years ago
Dear authors,
which version of deepspeed have you used? I am using deepspeed = 0.5.10 and get error with from deepspeed.ops.sparse_attention import MatMul, Softmax
from deepspeed.ops.sparse_attention import MatMul, Softmax
I import the module with from deepspeed.ops.sparse_attention.matmul import MatMul. However, IndexError happens in the forward.
from deepspeed.ops.sparse_attention.matmul import MatMul
best
Hi,
Perhaps #14 might be of help?
Thx for the reply. I upgrade Triton version and it works:)
Dear authors,
which version of deepspeed have you used? I am using deepspeed = 0.5.10 and get error with
from deepspeed.ops.sparse_attention import MatMul, Softmax
I import the module with
from deepspeed.ops.sparse_attention.matmul import MatMul
. However, IndexError happens in the forward.best