-
### Feature description
Add LSTM Algorithm to Neural Network Algorithms
**Feature Description:**
I would like to propose adding an LSTM (Long Short-Term Memory) algorithm to the existing neural…
-
### 🚀 The feature, motivation and pitch
I am working on a ML program and need to use sparse matrix multiplication with "reduce" operator.
Here is an example:
```
a = torch.sparse_coo_tensor(t…
-
The tensor in the Node similarity metric learning module cannot perform gradient backpropagation due to the greater operation, which leads to the parameters cannot being updated.
-
Hi! I am trying to train the instantmesh model but I am currently facing issues just before the backpropagation where I am getting cuda out of memory error. Have you faced a similar issue when trainin…
-
Hi everyone,
I have developed a custom Multi-Layer Perceptron (MLP) model using PyTorch, which has been pre-trained for my specific application. The model architecture has an input size of 579 feat…
-
Hello, I understand that W2D has shown good results with the ResNet model. My understanding is that in ResNet, the final feature maps represent high-level features, which W2D masks and updates through…
-
Hi,
I experienced `RuntimeError: an illegal memory access was encountered` when I train 3d gaussian on the T&T dataset. It seems to happen in backpropagation. [Here](https://drive.google.com/file/d/…
-
Thank you for your valuable open-source contribution!
In instruction tuning stage, it seems that only the answer aligned with the instruction participates in the backpropagation process. And [this…
-
```julia
using Flux
using Flux: param, Params, params, gradient
A = param(randn(5,2))
y = param(randn(5))
ls(A,y) = A\y
julia> ls(A,y)
Tracked 2-element Array{Float64,1}:
-0.3218743888384…
-
https://mattmazur.com/2015/03/17/a-step-by-step-backpropagation-example/