search

jeshraghian / snntorch

Deep and online learning with spiking neural networks in Python
https://snntorch.readthedocs.io/en/latest/
MIT License
1.35k stars 222 forks source link

R-CNN #182

Closed dev2y closed 1 year ago

dev2y commented 1 year ago

Hi is there any training example for R-CNN? Thanks.

jeshraghian commented 1 year ago

Not yet.

dev2y commented 1 year ago

@jeshraghian Thank you. But it is possible to do it. Right?

jeshraghian commented 1 year ago

Definitely! The best way to get started is to use a pre existing PyTorch implementation of R-CNN. Then between each Conv2d/Linear layer, include a Leaky neuron from snntorch.

You can pass the spikes from the Leaky layer to the pytorch layers.

It might struggle to learn anything to start with, so you may need to play around with optimizers, surrogate gradients, and lowering firing thresholds. It'll be a little tedious, but the discord channel is the best place to get help.

dev2y commented 1 year ago

Thank you. I will give it a try.