search

numenta / nupic-legacy

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.
http://numenta.org/
GNU Affero General Public License v3.0
6.33k stars 1.56k forks source link

Change SP's initialization of permanences to use a gaussian distribution #869

Open chetan51 opened 10 years ago

chetan51 commented 10 years ago

Experiment with initializing permanences using a gaussian distribution, with inputs close to the center of columns having high potential, and inputs farther away having low potential. This may give better results, especially when topology is enabled.

breznak commented 10 years ago

:+1:

this will also align with the CLA whitepaper..

chetan51 commented 10 years ago

Note: The discussion about distance function in https://github.com/numenta/nupic/issues/837 is relevant for this task.

iandanforth commented 10 years ago

@chetan51 I think you had a paper that showed this distribution being useful in other machine learning techniques, can you link that here?

chetan51 commented 10 years ago

Here it is: http://www.ict.griffith.edu.au/~johnt/publications/AI2013.pdf