search

event-driven-robotics / tactile_braille_reading

12 stars 7 forks source link

Catastrophic forgetting #3

Open 2103simon opened 4 months ago

2103simon commented 4 months ago

we encounter forgetting after a couple of epochs. we noticed, that the number of spikes keep increasing significantly in every layer (recurrent and readout) for every new epoch. that could have two reasons:

  1. the neurons can not integrate information -> trying to compensate with high number of spikes -> each spike less and less meaningful
  2. the time the membrane integrates information is too long -> spikes are not related to any actual input stimuli
2103simon commented 4 months ago

@theiera let's use this issue to have a short documentation for us to keep track of things we tried and the results.