a mixin for implementing Synaptic Intelligence (SI),
project files that run SI in an experimental setup identical to the one reported in the paper (on permutedMNIST), and
project files that run SI + dendrites on permutedMNIST.
Note that PyTorch buffers may have an obvious use case in implementing SI, but I decided not to use them. The implementation seems to be just fine without buffers, but we can revisit this option if it provides computational advantages.
This PR includes
Note that PyTorch buffers may have an obvious use case in implementing SI, but I decided not to use them. The implementation seems to be just fine without buffers, but we can revisit this option if it provides computational advantages.