search

SpikeAI / 2020-12_brainhack_Project7

Optimized Pipeline for the modelling of Spiking Neural Networks (SNNs)
GNU Affero General Public License v3.0
2 stars 0 forks source link

input: from events to spikes #6

Open laurentperrinet opened 3 years ago

laurentperrinet commented 3 years ago

Event-based cameras become increasingly available and bring a new way to transform visual input from a dense representation (frame-based) to an event-based one.

In this issue, we will try to use existing event-based datasets around the tonic library to provide the network with a SpikeSourceArray

laurentperrinet commented 3 years ago

I will start off with a notebook describing how we do so far in our model with @albertoarturovergani

laurentperrinet commented 3 years ago

done! (at last!)

The way we transform an analog movie to a SpikeSourceArray: https://github.com/SpikeAI/2020-11_brainhack_Project7/blob/main/input/B_SpikeSourceArray.ipynb

laurentperrinet commented 3 years ago

I have forked tonic into https://github.com/SpikeAI/tonic to be able to fix some errors...

laurentperrinet commented 3 years ago

I have now the possibility to import tonic datasets into pyNN:

output spikes

check out https://github.com/SpikeAI/2020-11_brainhack_Project7/blob/main/input/D_tonic2SpikeSourceArray.ipynb

laurentperrinet commented 3 years ago

Now, the goal is to produce events within tonic with a video (event-based simulator) and use that output for pyNN.

One question is to possibly add different layers to the input.