-
# 🚀 Feature
I think that it would be very helpful to allow sparse tensors to be used as masks (`attn_bias`) in the `memory_efficient_attention` function.
## Motivation
As the documentation no…
-
## 🐛 Bug
Sparse tensors can't be used in DataLoader running many workers
## To Reproduce
Steps to reproduce the behavior:
```python
import torch.utils.data as D
from scipy.sparse…
-
I am getting the following error when running a custom sparse model: RuntimeError: [Minuet] [.../csrc/minuet/cuda/helpers.cu (77)] CUBLAS Error: CUBLAS_STATUS_NOT_INITIALIZED
I think it might be du…
-
### Problem
The leaf optimization implements the following pseudocode for a given leaf (with a few extra things like exponential smoothing and softmaxes):
```
leaf_probabilities[j] = sum[over i] …
-
### 🚀 The feature, motivation and pitch
A sparse tensor can be viewed as a pair of indices and values that define the set of specified tensor elements. PyTorch supports sparse tensors with COO and …
pearu updated
2 years ago
-
## 🚀 Feature
Autograd support for the tensor multiplication of sparse tensors (sparse * sparse, sparse * dense).
## Motivation
Currently, an error occur during the calculation of autogr…
-
### 🐛 Describe the bug
When working with coalesced sparse COO tensors, calling `.div_` keeps the tensor coalesced, but `.mul_` does not. However, calling `.mul` returns a coalesced tensor.
```pyth…
-
Seems horrovod currently not support sparse tensor. "L-BFGS is currently unsupported, as are sparse tensors, which are required by SparseAdam optimizer"
Will support sparse tensor ?
-
- [ ] Sparse Tensor Methods
- [x] ndims
- [x] norm
- [x] shape slice
- [ ] mttkrp (partial implementation that only takes in factors, but not full ktensor)
- [ ] ttv (needed for…
-
Hi! Thank you guys for the better, cleaner new Keras! The promise of backend-agnostic models is just fantastic.
Problem is, the new framework seems to have lost some capabilities of its predecess…