Mixed-mode autodiff for RTRL

jeshraghian / snntorch

Deep and online learning with spiking neural networks in Python

https://snntorch.readthedocs.io/en/latest/

MIT License

1.29k stars 217 forks source link

Open jeshraghian opened 3 years ago

jeshraghian commented 3 years ago

Implement forward-mode AD for temporal connections; reverse-mode AD for layer connections
Update at each time step
Approximate BPTT without having to store any historical gradients

saiftyfirst commented 11 months ago

Willing to work on this. Could you give some more details please ?

ahenkes1 commented 11 months ago

@saiftyfirst , like this