search

emer / axon

Axon is a spiking, biologically-based neural model driven by predictive error-driven learning, for systems-level models of the brain
BSD 3-Clause "New" or "Revised" License
18 stars 8 forks source link

Adaptive threshold for VSPatch #246

Closed rcoreilly closed 1 year ago

rcoreilly commented 1 year ago

a fixed threshold is not working over the longer course of learning, resulting in elevated RewPred_NR causing incorrect GiveUp in boa later in training..

rcoreilly commented 1 year ago

the basic code for this is easy -- but we don't have an existing mechanism for saving and loading the adapted value with the weights.. there are other similar adapting values in LayerVals.ActAvgVals -- e.g., GiMult -- so presumably just add this there, but it is only relevant to one layer..

rcoreilly commented 1 year ago

no problem to add to wt save / load. adapting threshold working nicely overall.