numenta / htmresearch

Experimental algorithms. Unsupported.
GNU Affero General Public License v3.0
223 stars 109 forks source link

Default Union Pooler excite and decay functions and unittests #179

Open ryanjmccall opened 9 years ago

ryanjmccall commented 9 years ago

The Union Pooler by default does not decay its pooling activation and uses the simplest linear excitation function to positively update pooling activation. More sophisticated functions have been suggested, such as an exponential decay function and a logistic excite function. Recently, a step function was suggested for the excitation. Implementation of exponential decay and logistic excite has begun, but are unfinished and require complete unittesting. See https://github.com/numenta/nupic.research/tree/master/union_pooling/union_pooling/activation

ryanjmccall commented 9 years ago

@ywcui1990 FYI, as I wrote above, the current default decay in the Union Pooler is no decay and the current excite is linear. I'll let you take it from here =)

ywcui1990 commented 9 years ago

@rmccall84 Sounds good. I have implemented and used the logistic excite function and exponential decay function, and will write the unit tests for them.