Convolutional backward pass

hallvardnmbu / neurons

Modular neural networks from scratch, in Rust.

https://crates.io/crates/neurons

GNU General Public License v3.0

5 stars 1 forks source link

Convolutional backward pass #1

Closed hallvardnmbu closed 3 weeks ago

hallvardnmbu commented 2 months ago

Improper convolutional backward pass.

hallvardnmbu commented 4 weeks ago

Convolution backward runs in commit 2221e585b339bfdebe0eb019ee026dc0d1d6cf80.

Notes:

Only when input- and output channels are set to 0.
Does not seem to work properly.

hallvardnmbu commented 3 weeks ago

Current state relying partly on source and trying to wrap my head around it for three- and four-dimensional tensors.

Note: not complete! Test fails. But majorly improved as opposed to previous versions.

hallvardnmbu commented 3 weeks ago

Convolution backward pass seem to work properly!

hallvardnmbu commented 3 weeks ago

Something is wrong. Loss not improving as it should. Take a look into this.

hallvardnmbu commented 3 weeks ago

Seemingly not an issue in convolutional backward pass (d9fa2a6d1f58692439989cd15e829ad3825af675), but rather a bug somewhere else (3ce226dcc7dcf129a6e404414c294169fe6193f5).