search

pybrain / pybrain

BSD 3-Clause "New" or "Revised" License
2.86k stars 791 forks source link

Is there any existing support for sparse coding? #70

Open nhnifong opened 13 years ago

nhnifong commented 13 years ago

I'm trying to implement a sparse autoencoder with PyBrain. This is a simple neural network where the input and output are the same and you have one hidden layer with any number of nodes which is supposed to encode a compressed representation of the input/output. You enforce sparsity by introducing a penalty for the average activation of the hidden layer deviating from some small value, so that only a few hidden nodes are active at any time.

Is there any built in support in the trainers for this type of thing?

mshivers commented 12 years ago

I'm looking for exactly the same thing. So far no luck.

Fchaubard commented 10 years ago

Same here!

sahiliitm commented 10 years ago

Also does PyBrain support sparse input vectors? That is input vectors which only a few of the features activated/having non-zero values?