Batched Sparse Matrix - Batched Sparse Matrix multiplication

NVIDIA / CUDALibrarySamples

CUDA Library Samples

Other

1.5k stars 311 forks source link

Batched Sparse Matrix - Batched Sparse Matrix multiplication #168

Closed iminfine closed 8 months ago

iminfine commented 8 months ago

Can make spGEMM support also 3D tensor (might think as batched): suppose one sparse matrix has dimensions (B, M, N), the other has dimensions (B, N, F) and the multiplication result has dimensions (B,M,F)?

fbusato commented 8 months ago

Hi @iminfine, your idea is good. Unfortunately, we have limited bandwidth, and we need a strong use case for this feature. SpGEMM is a complex routine and adding batched computation, with potentially different sparsity patterns, would require significant effort on our side